Questions tagged [url]

A Uniform Resource Locator (URL) is a Uniform Resource Identifier (URI) that specifies where a particular resource is available – and the mechanism for retrieving it. They are often informally referred to as web addresses.

Filter by
Sorted by
Tagged with
3
votes
0answers
76 views

How to make okular open http/https links in PDFs with firefox?

I'm on FreeBSD and have compiled and installed the graphics/okular port (i.e. not much else of KDE4 other than okular's dependencies.) This has installed version 1.8.0. I start my X11 manually with ...
1
vote
1answer
1k views

Automating dirb for scanning several URLs

I have a bit of a problem making this script work and was wondering if anyone knew what the problem is. It is supposed to take a list of urls as input, scan them for sub directories and then output it ...
3
votes
3answers
971 views

xdg-open on debian 9 fails to open browser

I decided to try lxdm (was using fluxbox and xfce), and discovered that for many programs the url handler was failing, producing this error message; Quite strange as you can see, it's prepending the ...
2
votes
1answer
83 views

How to generate URL+title from URL list automatically? (using bash or other tool)

Using Linux Bash, how can one turn a text file with: http://example.org/ https://en.wikipedia.org/wiki/Main_Page https://www.youtube.com/watch?v=mGQFZxIuURE into: http://example.org/ Example Domain ...
1
vote
1answer
1k views

How to block keywords in https URL using squid proxy?

I want to block keyword "import" in any URL, including https websites. Example: http://www.abc.com/import/dfdsf https://xyz.com/import/hdovh How to create acl to do it? Thanks
7
votes
2answers
3k views

Firefox - reading out urls of opened tabs from the command-line

I sometimes have quite a big range of tabs open in Firefox and I prefer it to save them to a file, rather then using the build-in bookmarks. Therefore I (manually) copy the urls from the about:...
24
votes
5answers
47k views

Get URL's redirect target with curl

I would like to check where a single URL redirects. An example of that could be a link from Google's search result page (where a click always goes through Google server). Can I do that with curl?
98
votes
13answers
91k views

Decoding URL encoding (percent encoding)

I want to decode URL encoding, is there any built-in tool for doing this or could anyone provide me with a sed code that will do this? I did search a bit through unix.stackexchange.com and on the ...
1
vote
2answers
30 views

Automated URL Hyperlink creation

I have a document full of URL's that I need to turn into hyperlinks. I have no clue where to begin. My file looks like this but longer: http://somesite1.html http://somesiteAD.html And I need it ...
2
votes
1answer
398 views

cURL 404 Error - URL encoding with SharePoint URL

I am trying to connect to a SharePoint URL and pull the data in the form of a .json file. My URL looks like this: .../_api/web/lists/GetByTitle('titles list')/items If I give the URL as it is ...
1
vote
2answers
18k views

Type URL and show HTTP status

I want to make a shell script where I type an url and it returns me the status code.So far I've tested wget is there any other cause it has the tendency to save whatever you run. Then I tried to some ...
1
vote
1answer
691 views

Hosted URL shortener

We do encounter an issue with a JWT token length, which is used within a SSO system. One of our client is using outlook 2007 and there is a known bug regarding the length of a link provided inside an ...
3
votes
2answers
64 views

Can we specify service name and transport protocol in a URL?

A URL has its own syntax. In a URL, we can specify either hostname or IP address. Similarly, while we can specify port number, can we specify service name instead of port number ? If we can't, how ...
0
votes
2answers
47 views

How to save a web resource, applying decoding to URL Encoded Characters?

I would like to save this file with this URL "http://pti.regione.sicilia.it/portal/page/portal/PIR_PORTALE/PIR_LaStrutturaRegionale/PIR_AssessoratoEconomia/PIR_DipBilancioTesoro/PIR_Areetematiche/...
1
vote
1answer
1k views

Create a custom URL Protocol Handler

I would like to register a URL scheme (or protocol) handler for my own custom URL protocol, so that clicking on a link with this custom protocol will execute a command on that URL. Which steps do I ...
2
votes
3answers
3k views

curl page source from text file containing URLs

I have a text file containing up to 100 URLs. I am able to curl the page source from them using: cat /path/to/url.txt|xargs curl -o /path/to/output.txt This will download the page source for all of ...
1
vote
0answers
56 views

Nginx proxy_pass + ssl problem with seo friendly url

Below is nginx.conf server { listen 00.00.000.000:80; server_name my_site.com www.my_site.com; return 301 https://www.my_site.com$request_uri; } server { listen 00.00.000.000:443; server_name ...
0
votes
0answers
64 views

How to expose multiple api's for same set of backend servers in haproxy

I'm trying to create multiple endpoints for my service which is exposed to world through haproxy. My service is something like http://abcdomain.com/swagger-ui.html hitting this url provide some info ...
10
votes
2answers
2k views

Is there a browser that supports IPv6 Link Local addresses?

I'd like to know at last one browser that allows me to browse fe80::4216:7eff:fe9f:79ac%enp2s0f0, for example. I've checked there're many tickets open in bug trackers of big name browsers like Firefox ...
1
vote
0answers
71 views

xdg-open tries to open URLs as files on LXDE [duplicate]

I run $ xdg-open 'http://google.com' in /home/rominf/ and expect Firefox to open Google, but instead got GUI message with error: /home/rominf/http:/google.com: No such file or directory Firefox is ...
0
votes
1answer
39 views

Fetching title of browser

[Fetching user title] Seen a post prior of someone posting how to do it by single account I wish to do this from the range 1-1000 and have it output to >> .txt Example: x@nine:~# wget -qO- 'http:...
1
vote
0answers
44 views

Windows PDF viewer interprets hyperlinks incorrectly from Linux converted PDF?

I am operating on a RPi Model 3B with Jessie OS and Python version 2.7.9. I am using XlsxWriter (ver1.1.0) to write an .xlsx file and then converting it to PDF using LibreOffice's conversion code, as ...
0
votes
1answer
21 views

HTTP client saving download metadata

I am looking for a way to download files from the Web, while saving download metadata, like the requested URI, the returned status code and maybe even TLS certificate information (server certificate ...
1
vote
4answers
880 views

How to remove everything after http://example.com with awk or sed

Let's say I have an output file with a large quantity of URLs in it. How would I remove a part of the URL with awk or sed so that the final result would be http://example.com and not http://example....
1
vote
1answer
2k views

How can I force the IP address & hostname to only be exposed as example.com on a Tomcat Server?

I have a web server which is running on CentOS 6 on top of Tomcat7. Everything works fine, however, there are many ways that users can access the server. For instance: IP Address example.com www....
3
votes
1answer
6k views

Launch web page secured with HTTP authentication from a terminal kiosk

I am trying to launch Chromium to open a specific webpage that requires username and password login details. I can open the webpage no problem from the terminal however I have been unable to so far ...
0
votes
3answers
1k views

AWK: splitting URL into parts and print

I have these two http://www.example.com:8888/index.php http://home.example.com:8888/index.php (home can be anything but www) and want to get this: example.com home.example.com Preferably in some ...
0
votes
2answers
551 views

Get the domain name from IP address

I am using the following commands to get the domain name using the IP address dig -x IPaddress But it gives me some host names like ns1 etc. Is there any bash command that can give the actual domain ...
105
votes
2answers
156k views

Any way to encode the url in curl command?

I have some url which has space in it's query param. I want to use this in curl, e.g. curl -G "http://localhost:30001/data?zip=47401&utc_begin=2013-8-1 00:00:00&utc_end=2013-8-2 00:00:00&...
5
votes
2answers
8k views

Terminal - create hyperlinks

I am creating Log-Reports which are viewable through the Web-browser. Is there an easy way to make links clickable in Linux Terminal? (Gnome-Terminal) I am copying those links and manually open my ...
3
votes
1answer
82 views

How to register new protocol URL in windows manager

When you open a link on the internet such as ftp://myserver.com, it prompts you to open the link with your FTP client of choice. Same thing with irc://freenode.net. It prompts you to open the link ...
0
votes
2answers
81 views

Capture internet traffic on single interface

I have been asked by a customer to provide a list of all URL's that my company's linux server connects to in order to complete a software update including individual TCP,UDP ports that these ...
0
votes
0answers
1k views

Download a URL containing a token query string

To explain what I want I will give an example (My foreign friends sorry it is in Arabic not English :D ) . Let's take this URL for example. When you open it a blue square will appear after a 5 ...
1
vote
1answer
114 views

How would I make a web redirect server that changes the incoming port to 80?

Basically I have hidden my server behind cloudflare. My server listens on port 80 and port 25461, and cloudflare only protects on certain ports, 80 being one of them. But I have a lot of users, ...
1
vote
0answers
73 views

How to properly move weblinks from my browser to a folder via drag and drop in Debian with KDE? (page titles not shown)

Besides having my desktop span over multiple monitors I'd also like to be able to move weblinks to it (or to folders on it). I'm running Debian 9.1 with KDE and am using the standard Dolphin file-...
0
votes
1answer
663 views

sources.list repository URL for Debian security updates with or without “debian-security” path?

After installing Debian 9.1, the sources.list entry for security updates used this URL: http://security.debian.org/debian-security According to SourcesList and Security Information, the URL is: ...
0
votes
1answer
683 views

Increment Numbers in URL?

I want to create a list of URLs. The URLs have two sets of identical numbers which need to be incremented by 1: http://sample.com/poilus/cwrgshs/192/192.html http://sample.com/poilus/cwrgshs/193/193....
1
vote
4answers
225 views

How I can determine the latest version in URL?

I'm trying to put a "function" inside of a script to install the latest version of "TeamSpeak3" Client and make all configurations. My problem is I don't know how to make a function to test the ...
0
votes
2answers
600 views

sed to replace text url to html url

I have a bunch of URL in a text file. As Firefox seems unable to load these URL directly, I must convert them to HTML. Trying with sed doesn't work: sed -e 's/^(.*)$/<a href="\1">\1<\/a>&...
1
vote
0answers
48 views

What is the recommended way to retrieve host and repository from git URL

Think of a utility like gerrit-sh which uses git config options to determine where the gerrit host is located. The context for my question is this function get_repo_remote_config(). So I want to ...
0
votes
1answer
333 views

Download a single image from Google Street View

I just found that we can see Google Street View images from the following link: https://maps.googleapis.com/maps/api/streetview?size=640x640&location=38.3810257,-89.486167&heading=0 (where ...
0
votes
2answers
65 views

Create a url file with multiple links

i need to edit the page number of multiple url links in the text file. eg: http://gk4success.com/questions.php?page=1&parent=0&lang=2&c-id=27&q_type= ... http://gk4success.com/...
0
votes
1answer
84 views

How to save file and corresponding url?

Suppose, I download a book from a URL(using wget or other tool). I want to save the book and the URL, so that I can know from where I downloaded the book. I don't use different file. I want to save ...
3
votes
1answer
312 views

Problem with url encoding on debian sources.list

I am trying to add a repository (datastax) to my sources. This repository ask you to add your username and password, and also warn that you will have to urlencode special characters. So I added: deb ...
6
votes
4answers
2k views

Extracting substring from environment variable

In a bash or zsh script, how might I extract the host from a url, e.g. unix.stackexchange.com from http://unix.stackexchange.com/questions/ask, if the latter is in an environment variable?
5
votes
3answers
1k views

Wget Won't Recursively Download

I'm trying to copy a forum thread with this directory structure: The first page has a URL like this: https://some.site.com/foo/bar/threadNumber And the rest of the pages follow this format: https:/...
1
vote
4answers
280 views

Extract URL from specific pattern (Google Alert)

I have tried every possible (to my poor knowledge) combination of grep and sed commands, but fail to extract URLs with the following pattern (Google Alert e-mails in plaintext): "url": "https://www....
3
votes
2answers
10k views

What are the URIs starting with file:// or application://?

Using Linux, I have more than once seen URIs of files and applications starting with file:// and application://. What are those URIs and how to use them?
0
votes
1answer
101 views

Reload a local script from a URL available source code?

I have a long script (>500 rows) I load in each bootstrapping of a webpage, from a local file. The source code of this script is often updated and presented under a certain URL so that all users could ...
4
votes
5answers
4k views

Get the query string from URLs in a log file

I have a server log file that contains a number of log entries in the following format: 193.1.172.46 - - [23/Mar/2008:03:57:38 +0000] "GET /robots.txt HTTP/1.0" 404 289 "-" "gsa-crawler (Enterprise; ...