Questions tagged [url]
A Uniform Resource Locator (URL) is a Uniform Resource Identifier (URI) that specifies where a particular resource is available – and the mechanism for retrieving it. They are often informally referred to as web addresses.
100
questions
2
votes
1answer
55 views
How to generate URL+title from URL list automatically? (using bash or other tool)
Using Linux Bash, how can one turn a text file with:
http://example.org/
https://en.wikipedia.org/wiki/Main_Page
https://www.youtube.com/watch?v=mGQFZxIuURE
into:
http://example.org/ Example Domain
...
1
vote
2answers
26 views
Automated URL Hyperlink creation
I have a document full of URL's that I need to turn into hyperlinks. I have no clue where to begin.
My file looks like this but longer:
http://somesite1.html
http://somesiteAD.html
And I need it ...
3
votes
2answers
58 views
Can we specify service name and transport protocol in a URL?
A URL has its own syntax.
In a URL, we can specify either hostname or IP address. Similarly, while we can specify port number, can we specify service name instead of port number ?
If we can't, how ...
0
votes
2answers
44 views
How to save a web resource, applying decoding to URL Encoded Characters?
I would like to save this file with this URL "http://pti.regione.sicilia.it/portal/page/portal/PIR_PORTALE/PIR_LaStrutturaRegionale/PIR_AssessoratoEconomia/PIR_DipBilancioTesoro/PIR_Areetematiche/...
1
vote
1answer
875 views
Create a custom URL Protocol Handler
I would like to register a URL scheme (or protocol) handler for my own custom URL protocol, so that clicking on a link with this custom protocol will execute a command on that URL. Which steps do I ...
1
vote
0answers
54 views
Nginx proxy_pass + ssl problem with seo friendly url
Below is nginx.conf
server {
listen 00.00.000.000:80;
server_name my_site.com www.my_site.com;
return 301 https://www.my_site.com$request_uri;
}
server {
listen 00.00.000.000:443;
server_name ...
0
votes
0answers
52 views
How to expose multiple api's for same set of backend servers in haproxy
I'm trying to create multiple endpoints for my service which is exposed to world through haproxy.
My service is something like http://abcdomain.com/swagger-ui.html hitting this url provide some info ...
0
votes
0answers
32 views
xdg-open tries to open URLs as files on LXDE [duplicate]
I run
$ xdg-open 'http://google.com'
in /home/rominf/ and expect Firefox to open Google, but instead got GUI message with error:
/home/rominf/http:/google.com: No such file or directory
Firefox is ...
0
votes
1answer
39 views
Fetching title of browser
[Fetching user title]
Seen a post prior of someone posting how to do it by single account
I wish to do this from the range 1-1000 and have it output to >> .txt
Example:
x@nine:~# wget -qO- 'http:...
1
vote
0answers
42 views
Windows PDF viewer interprets hyperlinks incorrectly from Linux converted PDF?
I am operating on a RPi Model 3B with Jessie OS and Python version 2.7.9.
I am using XlsxWriter (ver1.1.0) to write an .xlsx file and then converting it to PDF using LibreOffice's conversion code, as ...
0
votes
1answer
19 views
HTTP client saving download metadata
I am looking for a way to download files from the Web, while saving download metadata, like the requested URI, the returned status code and maybe even TLS certificate information (server certificate ...
2
votes
2answers
808 views
xdg-open on debian 9 fails to open browser
I decided to try lxdm (was using fluxbox and xfce), and discovered that for many programs the url handler was failing, producing this error message;
Quite strange as you can see, it's prepending the ...
0
votes
3answers
980 views
AWK: splitting URL into parts and print
I have these two
http://www.example.com:8888/index.php
http://home.example.com:8888/index.php (home can be anything but www)
and want to get this:
example.com
home.example.com
Preferably in some ...
0
votes
2answers
293 views
Get the domain name from IP address
I am using the following commands to get the domain name using the IP address
dig -x IPaddress
But it gives me some host names like ns1 etc. Is there any bash command that can give the actual domain ...
3
votes
1answer
79 views
How to register new protocol URL in windows manager
When you open a link on the internet such as ftp://myserver.com, it prompts you to open the link with your FTP client of choice. Same thing with irc://freenode.net. It prompts you to open the link ...
0
votes
2answers
77 views
Capture internet traffic on single interface
I have been asked by a customer to provide a list of all URL's that my company's linux server connects to in order to complete a software update including individual TCP,UDP ports that these ...
2
votes
1answer
383 views
cURL 404 Error - URL encoding with SharePoint URL
I am trying to connect to a SharePoint URL and pull the data in the form of a .json file. My URL looks like this:
.../_api/web/lists/GetByTitle('titles list')/items
If I give the URL as it is ...
0
votes
0answers
985 views
Download a URL containing a token query string
To explain what I want I will give an example (My foreign friends sorry it is in Arabic not English :D ) .
Let's take this URL for example. When you open it a blue square will appear after a 5 ...
1
vote
4answers
799 views
How to remove everything after http://example.com with awk or sed
Let's say I have an output file with a large quantity of URLs in it. How would I remove a part of the URL with awk or sed so that the final result would be http://example.com and not http://example....
1
vote
1answer
111 views
How would I make a web redirect server that changes the incoming port to 80?
Basically I have hidden my server behind cloudflare. My server listens on port 80 and port 25461, and cloudflare only protects on certain ports, 80 being one of them.
But I have a lot of users, ...
0
votes
1answer
624 views
sources.list repository URL for Debian security updates with or without “debian-security” path?
After installing Debian 9.1, the sources.list entry for security updates used this URL:
http://security.debian.org/debian-security
According to SourcesList and Security Information, the URL is:
...
6
votes
2answers
3k views
Firefox - reading out urls of opened tabs from the command-line
I sometimes have quite a big range of tabs open in Firefox and I prefer it to save them to a file, rather then using the build-in bookmarks.
Therefore I (manually) copy the urls from the about:...
1
vote
0answers
69 views
How to properly move weblinks from my browser to a folder via drag and drop in Debian with KDE? (page titles not shown)
Besides having my desktop span over multiple monitors I'd also like to be able to move weblinks to it (or to folders on it).
I'm running Debian 9.1 with KDE and am using the standard Dolphin file-...
0
votes
2answers
520 views
sed to replace text url to html url
I have a bunch of URL in a text file.
As Firefox seems unable to load these URL directly, I must convert them to HTML.
Trying with sed doesn't work:
sed -e 's/^(.*)$/<a href="\1">\1<\/a>&...
1
vote
0answers
47 views
What is the recommended way to retrieve host and repository from git URL
Think of a utility like gerrit-sh which uses git config options to determine where the gerrit host is located. The context for my question is this function get_repo_remote_config(). So I want to ...
0
votes
1answer
317 views
Download a single image from Google Street View
I just found that we can see Google Street View images from the following link:
https://maps.googleapis.com/maps/api/streetview?size=640x640&location=38.3810257,-89.486167&heading=0
(where ...
0
votes
2answers
59 views
Create a url file with multiple links
i need to edit the page number of multiple url links in the text file.
eg:
http://gk4success.com/questions.php?page=1&parent=0&lang=2&c-id=27&q_type=
...
http://gk4success.com/...
0
votes
1answer
67 views
How to save file and corresponding url?
Suppose, I download a book from a URL(using wget or other tool). I want to save the book and the URL, so that I can know from where I downloaded the book.
I don't use different file. I want to save ...
3
votes
1answer
284 views
Problem with url encoding on debian sources.list
I am trying to add a repository (datastax) to my sources. This repository ask you to add your username and password, and also warn that you will have to urlencode special characters.
So I added:
deb ...
6
votes
4answers
2k views
Extracting substring from environment variable
In a bash or zsh script, how might I extract the
host from a url, e.g. unix.stackexchange.com from
http://unix.stackexchange.com/questions/ask, if the latter is in an environment variable?
5
votes
3answers
1k views
Wget Won't Recursively Download
I'm trying to copy a forum thread with this directory structure:
The first page has a URL like this:
https://some.site.com/foo/bar/threadNumber
And the rest of the pages follow this format:
https:/...
1
vote
4answers
252 views
Extract URL from specific pattern (Google Alert)
I have tried every possible (to my poor knowledge) combination of grep and sed commands, but fail to extract URLs with the following pattern (Google Alert e-mails in plaintext):
"url": "https://www....
0
votes
1answer
101 views
Reload a local script from a URL available source code?
I have a long script (>500 rows) I load in each bootstrapping of a webpage, from a local file. The source code of this script is often updated and presented under a certain URL so that all users could ...
4
votes
5answers
4k views
Get the query string from URLs in a log file
I have a server log file that contains a number of log entries in the following format:
193.1.172.46 - - [23/Mar/2008:03:57:38 +0000] "GET /robots.txt HTTP/1.0" 404 289 "-" "gsa-crawler (Enterprise; ...
1
vote
1answer
650 views
Hosted URL shortener
We do encounter an issue with a JWT token length, which is used within a SSO system. One of our client is using outlook 2007 and there is a known bug regarding the length of a link provided inside an ...
3
votes
1answer
119 views
Why does xdg-open remove @ from a URI if it's the first character in the path?
I'm trying to get xdg-open to properly handle URIs with the pattern of ob://@username but it seems that xdg-open is stripping the @ symbol. Is there someway to prevent this without modifying xdg-open ...
4
votes
1answer
141 views
Thunderbird: wrap long URLs when displaying message
When I receive an email with a long URL, Icedove (Thunderbird) does not wrap the URL in the message window, but instead shows the long URL in one long line. Additionally, a horizontal scroll bar ...
1
vote
1answer
989 views
Automating dirb for scanning several URLs
I have a bit of a problem making this script work and was wondering if anyone knew what the problem is. It is supposed to take a list of urls as input, scan them for sub directories and then output it ...
1
vote
0answers
666 views
.htaccess for redirecting an URL with hashtag
I have urls which I need to redirect to another URL. The issue is that the source URLs contain # character.
source url: http://www.wawa.com/fr/#/creations/eclairs
redirect to : http://www.wawa.fr/fr/...
0
votes
1answer
49 views
Is it possible people use Linux commands to change link locations as you're clicking on them?
In theory, is it possible that people use features included in Linux distros as standard to change link locations as they are clicked, and direct people to different websites.
An example of this ...
4
votes
2answers
7k views
Terminal - create hyperlinks
I am creating Log-Reports which are viewable through the Web-browser. Is there an easy way to make links clickable in Linux Terminal? (Gnome-Terminal)
I am copying those links and manually open my ...
17
votes
1answer
2k views
Why does this ffmpeg command work in bash and not zsh?
Today I got home from work (run bash on an Ubuntu box) and tried to run some code on my local arch box with my beloved zsh and the commands were failing?
The command is below with the personal info ...
1
vote
2answers
289 views
How to use a greped url provided by tshark inside a bash script?
I'm trying to use a url piped from tshark into a while loop.
while read line ; do
echo "$line"
ffmpeg -i "$line" -c copy "filename"
done < <(tshark -i tun0 -B 50 -P -V -q -l -Y 'http matches "(...
10
votes
2answers
2k views
Is there a browser that supports IPv6 Link Local addresses?
I'd like to know at last one browser that allows me to browse fe80::4216:7eff:fe9f:79ac%enp2s0f0, for example. I've checked there're many tickets open in bug trackers of big name browsers like Firefox ...
2
votes
1answer
217 views
Extract URL from non-formatted text
I've found only examples on extracting substrings from formatted text like HTML files, but in my case I need to output a list of URLs for example:
...
https://twitter.com/user1/status/xyza
https://...
0
votes
1answer
296 views
How to extract all links from a given url in a decent time
I'm trying to extract the links from a specified url and redirect them to a file.
At first I tried using --spider , this is my code:
wget --spider --force-html -m http://file/path 2>&1 | grep ...
0
votes
2answers
286 views
URL instead of file in linux command parameters
Is there a way to put URL of a file instead of a file in parameters of a linux command?
To be specific I am looking for a way to store dhcp.lease file remotely but dhcp accept just file. How can I do ...
1
vote
1answer
1k views
How to block keywords in https URL using squid proxy?
I want to block keyword "import" in any URL, including https websites. Example:
http://www.abc.com/import/dfdsf
https://xyz.com/import/hdovh
How to create acl to do it?
Thanks
2
votes
1answer
6k views
Launch web page secured with HTTP authentication from a terminal kiosk
I am trying to launch Chromium to open a specific webpage that requires username and password login details. I can open the webpage no problem from the terminal however I have been unable to so far ...
2
votes
3answers
3k views
curl page source from text file containing URLs
I have a text file containing up to 100 URLs. I am able to curl the page source from them using:
cat /path/to/url.txt|xargs curl -o /path/to/output.txt
This will download the page source for all of ...
