Data Collection Techniques
|About this Data Collection Techniques Page|
- 1 Active Web Contents
- 2 Border Gateway Protocol
- 3 Browser Fingerprinting
- 4 Browser History and Cache
- 5 Cookies
- 6 DNS Name Resolution
- 7 HTML5 Canvas Image Data
- 8 IP Address
- 10 MAC Address
- 11 Network Leaks
- 12 TCP Timestamps
- 13 TLS Session Resumption
- 14 Web (Email) Beacons and Banner Ads
- 15 License
- 16 Footnotes
Active Web Contents
Web content that is accessible by browser plugins such as Flash [archive], Java [archive], ActiveX [archive] and Silverlight [archive] renders the Web more dynamic and colorful. However, permissions are also granted to websites to execute code locally on a machine, increasing the security risks. If executed, these plugins can read a host of details about the user's computer and network configuration and send it to a remote server. Certain techniques even permit files to be read and edited on the user's machine, and in extreme cases this allows complete control over it.
Limiting browsing to trusted websites does not mitigate the risk from applets. In the recent past, numerous popular websites have been hacked and infected with malicious code. Greater security requires these plugins to be blocked, deactivated or removed.
With Whonix ™, an adversary will not benefit from learning the IP address via this method: it is either a local IP address shared among all Whonix ™ users or the IP address of a Tor exit relay, both of which do not reduce the user's anonymity set. Further, the MAC address is a virtual one which is also shared among all Whonix ™ users, and is therefore worthless to attackers. Although active content will not reveal the real IP address, it is deactivated in Tor Browser by default. See Browser Plugins for a detailed discussion of browser plugins in Whonix ™ and the potential effects on anonymity, security, and privacy.
Border Gateway Protocol
The Border Gateway Protocol (BGP) refers to the routing protocol for the Internet: 
The BGP protocol specifies a TCP-based communications method for establishing routed peerings between Autonomous System (AS) [archive] border routers (ASBRs), that facilitate the exchange of information about routable IP prefixes. BGP peerings exist between all active Internet Autonomous Systems.
BGP is a path vector protocol, and BGP-enabled ASBRs send path vector messages to each other with lists of Internet-routable IP prefixes along with a Autonomous System (AS) paththe list of ASNs that must be traversed to reach that prefix.
BGP currently manages nearly 800K Internet-routable prefixes across the Internet.
Unfortunately the BGP protocol is prone to leaks and vulnerable to traffic shaping.
In this attack, groups of IP addresses are taken over via corruption of Internet routing tables maintained by the BGP: 
- Adversaries re-route traffic for interception or modification purposes by maliciously manipulating BGP IP prefixes -- with a specific IPV4 or IPV5 address block and a path of AS numbers, the specific ASNs the traffic must pass through (to reach the announced address block) are controlled.
- Edge routers are then configured to announce prefixes that have not been assigned to them, leading to Internel-level BGP hijacking. If a shorter or more specific path is offered (or claimed), then the traffic is relayed to the hijacker. 
- The address blocks of hijackers usually disappear faster than normal - suspicious networks last 50 days on average compared to almost two years for legitimate networks.
- Serial hijackers generally advertise more IP address blocks ("network prefixes").
- Networks advertised by serial hijackers are often registered in different countries and continents, in stark contrast to legitimate networks.
The IETF has defined this phenomenon: 
The Internet Engineering Task Force (IETF) in RFC 7908 provides a working definition of a BGP Route Leak as "the propagation of routing announcement(s) beyond their intended scope. That is, an announcement from an Autonomous System (AS) of a learned BGP route to another AS is in violation of the intended policies of the receiver, the sender, and/or one of the ASes along the preceding AS path."
Leaks pose security and privacy threats, since traffic can be redirected through unintended paths which may enable eavesdropping or traffic analysis. Leaks can be either accidental or malicious, but they usually arise from 'honest' mis-configurations. Visibility is necessary so it is possible for network operators to identify ISPs that are propagating bad routes (which are advertised during a route leak). This necessitates proper network monitoring tools so good actors can visualize and immediately modify any BGP-initiated route changes. 
Research from a pool of 500,000 Internet users has shown that the vast majority (84%) have unique browser configurations and version information which makes them trackable across the Internet. When Java or Flash is installed, this figures rises to 94%.  Considering this research relied on a relatively small number of variables,  companies with advanced fingerprinting capabilities may be approaching 100%, particularly in combination with cookies.
Fingerprinting and Anonymity
For anonymity purposes, it is necessary to reduce the number of bits of information (entropy) the browser provides to an acceptable lower bound; for instance, 18.1 bits of entropy means that a browser chosen at random will share the fingerprint with one in 286,777 other browsers.  Browser uniqueness research has revealed the entropy associated with various pieces of browser information: 
Table: Browser Fingerprinting Estimates
Table: Common Fingerprinting Methods 
|AudioContext Fingerprinting||The Audio API is used to fingerprint users by generating an audio signal with the oscillator and hashing the resulting signal to create an identifier; no access to the microphone is required since measurement relies on signal processing differences.  |
|Battery API||The Battery Status API allows websites to query the browser for the charging status of a host device or the current battery level. There are sufficient states and a long enough lifespan for short-term identifiers to enable tracking. |
|Clock skew/precision measurements||Differential parameters are used to measure the time difference (down to milliseconds) between a user's computer and that of the server. Clock precision measurements rely upon how long operations take on a partricular system.|
|Fonts||System fonts are collected by Flash or Java applets, or by CSS introspection.|
|HTML5 canvas||A precise fingerprint is provided by the rendering of WebGL, font and color data to a canvas element. This is then extracted from the image buffer, and an identifying hash is computed. For more information, see here.|
|HTTP Accept headers||With every webpage request, the browser sends URL variables within the HTTP protocol framework that can be analyzed. This includes personalized language, browser type and version, operating system and version, supported character / font sets, file codecs, and the last visited webpage.|
|Screen resolution||The exact resolution is revealed to websites, for example |
|Supercookies||Reported entropy depends on whether the following are enabled: DOM localStorage, DOM sessionStorage, userData, Flash LSOs, Silverlight cookies, HTML5 databases, or DOM globalStorage.|
|User Agent string||When websites are visited, the browser sends precise information on the operating system and web browser being used. |
- Use of Torbutton [archive], which is bundled with Tor Browser and enabled by default. 
- Use of mobile devices like Android and iPhone.
- Corporate desktop machines which are clones of one another.
- The User Agent is uniform for all Torbutton users.
- Plugins are blocked.
- The screen resolution is rounded down to 50 pixel multiples.
- The timezone is set to GMT.
- DOM Storage is cleared and disabled.
Browser History and Cache
A user's browser history and cache enables the possibility of history sniffing attacks: 
- Inspection of style properties to infer browser history.
- Transfer of the browser's history to the network.
- Actual history hijacking.
Websites can tell which sites are saved in a user's browser history using specialized commands and design elements. Three example are outlined below.
- CSS stylesheets: Commonly the visited website will embed special formatting commands (CSS Stylesheets) that contain external links "of interest" on the pages that are visited. If one of the external websites have been visited before, the browser will react by executing a command defined in the format, for example by downloading a small picture from the website. In this way the website can learn and/or make educated guesses about the contents of a user's browser history.
- ETags: The contents of the browser cache can reveal previously visited websites. Along with the website URL and numerous page elements, the browser caches also store an ETag sent by the server. If the website is visited again, the ETag is first sent to ask for changes. ETags can contain unique user IDs, which have been used by companies like KISSmetrics [archive] to identify persons visiting some of the top 100 websites.
- Website page load time: The time required for a website page to load changes when it is partially stored in the browser cache. By subtle placement of the images on the website, the server can analyze the cache elements one by one. 
The obvious corporate business case for information collected via history sniffing is targeted advertising. However, the same technique can be used to deanonymize web surfers.
Consider the following attack vector, outlined in a publication [archive] by security researchers iSecLab. Browser history was used to collect the groups visited in the social network "Xing." Logically, it is improbable that two or more people would share membership of the same set of groups within a social network. Therefore, when this information was revealed it was possible to associate users with their real names and e-mail addresses.
The only reliable protection against analysis of a user's browser history is to use Tor Browser:
- This "feature" is deactivated by default.
- Tor Browser bypasses the cache for third party content to protect users. 
- The cache is deleted automatically when the browser is closed.
Deactivating the browser cache is not recommended, since it can have a deleterious impact on browsing speed.
Cookies have been in existence since 1994, when they were conceived by a programmer working for Netscape Communications as a reliable method for e-commerce applications. According to Wikipedia: 
An HTTP cookie (also called web cookie, Internet cookie, browser cookie, or simply cookie) is a small piece of data sent from a website and stored on the user's computer by the user's web browser while the user is browsing. Cookies were designed to be a reliable mechanism for websites to remember stateful information (such as items added in the shopping cart in an online store) or to record the user's browsing activity (including clicking particular buttons, logging in, or recording which pages were visited in the past). They can also be used to remember arbitrary pieces of information that the user previously entered into form fields such as names, addresses, passwords, and credit card numbers.
Whonix ™ users are probably most familiar with third-party cookies [archive] since they can be used to track browsing history via web page content sourced from external websites, such as banner advertisements. However, cookies have a range of both useful and potentially harmful applications. 
Table: Cookie Classification 
|Authentication Cookies||Used by web servers to know whether a user is logged in, and the account being used.|
|Persistent Cookies||Expire after a specific period of time, or on a set date. They transmit information to servers every time a user browses websites that are associated with the cookie. Persistent cookies can track a user's browsing habits over an extended period, possibly years. |
|Secure Cookies||Transmitted over encrypted (HTTPS) connections, making them less vulnerable to cookie theft.|
|Session Cookies||Exist temporarily in memory while a website is navigated and are normally deleted when the browser is closed.|
|Supercookies||Have an origin of a top-level domain [archive] like or a public suffix such as . If not blocked by the browser, adversaries in control of malicious websites can set supercookies and then impersonate or disrupt user requests to another website sharing the same top-level domain or public suffix.|
Belong to domains that are different from the URL shown in the web browser address bar. Tracking is enabled via the following process:
With 80% of users disapproving of tracking while browsing the Internet, they have progressively started to delete cookies with relevant browser settings and extensions. Advertisement and tracking networks have responded in kind, using more sophisticated methods - evercookies - to distinguish users. The various forums of evercookies are described below.
Table: Evercookie Classification
|Entity Tag (ETag) Cookies||HTTP supports simple cache control mechanisms, including ETags which store either a version number or a user identifier (ETag cookie). The purpose is to save bandwidth and have browsers use caches for web content when it has not changed, instead of reloading the complete web server content again.  Unfortunately this provides a tracking mechanism which can be persistently stored, and has been used by various websites including . ETag cookies can be, and often are respawned. |
|Flash Cookies (LSOs)||Flash cookies are also known as local shared objects (LSOs) [archive] and store data from websites that use Adobe Flash. User permission is not sought when cookies are stored, and they are stored outside of normal browser local storage system.  Previously, it was difficult to delete Flash cookies, as they could not be located easily with browsers.  However, modern browsers, extensions and software [archive] have relevant settings [archive] to easily remove them.  LSOs can be used to:  |
|HTML5 DOM [archive] Cookies [archive]||Allow web application software to store data persistently in a manner similar to cookies. Local storage and session-only storage are both possible. The storage size is far greater than that available to cookies, but it is not automatically transmitted on every HTTP request. Instead, client-side scripts allow the desired interaction with the server. It is possible to remove DOM cookies without about:config changes in Firefox , or by using relevant extensions (like Click&Clean or BetterPrivacy). However, this action is no longer necessary since DOM cookies are disabled in Firefox 58 onward. Tor Browser also defends against this technique by default. |
|Zombie Cookies||Automatically recreated after being deleted. Cookie content is stored in multiple locations such as HTML5 web storage [archive], Flash Local shared object [archive], client-side and server-side locations. When the cookie is deleted on a user's computer, this is detected and restored from one of the other cookie storage locations.|
|Other Methods||Samy Kamkar has demonstrated that there are other possible methods [archive] to track Internet users using evercookies.|
In a study by the University of California, Berkeley [archive] the methods of Space Pencil Inc. (aka KISSmetrics) were exposed. In addition to cookies and flash cookies, KISSmetrics used cache cookies via ETags, DOMStorage and IE-userData to distinguish each user. KISSmetrics was sued as a result and dispensed with using ETags. It also allegedly now respects the Do Not Track [archive] HTTP header. 
Tor Browser, which comes bundled with Whonix ™, resists evercookies.
It is evident that cookies are useful for website personalization, logins, monitoring purchases and other functions, but they also present a dire tracking threat. The average website places 34 cookies on a device on the first visit, and 70 percent of these are third-party cookies. Expiry dates are often set to the year "9999", indicating there is no intention to ever stop recording user behavior. 
A 2011 study by the University of California, Berkeley [archive] found that the top 100 websites at that time stored a total of 5,675 cookies. Of these, 4,914 cookies were set by third party domains and not the first-party domain being purposefully visited by the user. When browsing these 100 websites, data was transmitted to 600 servers.
Cookie security is dependent on whether cookie data is encrypted, since adversaries may otherwise use this information to gain access to user data or to access websites with the user's credentials. Examples of this attack include cross-site scripting [archive] and cross-site request forgery [archive].
As well as gathering the IP address and/or the HTTP referrer field of the computer requesting the web page, cookies can also store the requested URL and the date/time of the request. Web hosts are therefore capable of recording a large proportion of browsing behavior over many years, and correlating the accumulated profile data with individuals. The typical Internet user has collected hundreds of cookies from various websites on their PC without their knowledge. For instance, the following figure exhibits a small number of the cookies that are stored when a request is made to.
Figure: Cookies set by the New York Times
Most modern browsers integrate an optional function to block cookies, but the option has to be first set by the user. Tor Browser, which comes bundled with Whonix ™, has activated cookie blocking by default. Firefox has also adopted Tor Browser's first party isolation [archive] feature since version 55, meaning cookies are separated on a per-domain basis. Advertisement trackers are unable to see all the cookies stored on a user's computer (only the cookie for the currently viewed domain), meaning they cannot aggregate persistent cookie data for profiling. In the future, it is expected that more functions will become available to administrate preferences and acquired cookie collections.
DNS Name Resolution
Browsing history can easily leak to the network via the Domain Name System [archive]. During the DNS name resolution process, hostnames like www.whonix.org are mapped to their respective IP address (like
192.168.1.1) so the relevant application can connect.  Unless DNS traffic is encrypted it is vulnerable to sniffing by network observers. 
Any device searching for a DNS record must communicate with a DNS server to do so. DNS queries are sent in clear text via the UDP or TCP protocol, meaning passive network observers can see all lookups that are performed. For instance, it is documented the IC rely on advanced tools [archive] to undertake passive surveillance, as well as hijacking DNS when required.
This means people with access to the DNS server or advanced network observers can easily link the device's IP address to exact websites, email, chat and other visited domains and when/how often these records are accessed.   Some ISPs even log DNS queries and share this information to third parties in an opaque fashion. Considering user IDs and even MAC addresses are embedded by some ISPs within DNS queries, this allows for intimate fingerprinting.  
DNS look-ups are capable of leaking if a user or application networking change is improperly configured. Attacks in the wild have relied upon DNS to bypass firewalls and exfiltrate data, since the attack vector is less commonly known.
The two primary defenses against the DNS threat are: 
- Proxies: Tor and VPNs can re-route or anonymize DNS queries, which masks the source IP address. Tor is far stronger by design, since trust is distributed among multiple relays; this is unlike the complete trust placed in a single VPN provider. 
- Intermediate DNS servers: Some rely on servers that are supposedly configured with minimal logging, and which are an alternative to untrusted, primary DNS servers. This method is not recommended, since the trust is simply shifted to other, potentially malicious parties. 
A longer term solution for all traffic might be changing DNS to issue queries over TLS, since it is an encrypted protocol. This would prevent passive surveillance and allow validation of the server which has been chosen as a DNS service; some experimental DNS servers [archive] are already in operation. Unfortunately this solution is unlikely to be widely adopted anytime soon. Other potential solutions include: DNS over DTLS, DNSCrypt, DNS over HTTPS (proxied), DNS over QUIC, and DNSCurve. 
HTML5 Canvas Image Data
In 2016, researchers from Princeton University discovered HTML canvas fingerprinting scripts on 14,371 of the top 1 million websites.  When combined with other exposed browser settings this can be enough to uniquely identify an individual, even without access to the specific IP address. 
The Tor Project provides a good explanation of this fingerprinting method: 
After plugins and plugin-provided information, we believe that the HTML5 Canvas [archive] is the single largest fingerprinting threat browsers face today. Studies [archive] show [archive] that the Canvas can provide an easy-access fingerprinting target: The adversary simply renders WebGL, font, and named color data to a Canvas element, extracts the image buffer, and computes a hash of that image data. Subtle differences in the video card, font packs, and even font and graphics library versions allow the adversary to produce a stable, simple, high-entropy fingerprint of a computer. In fact, the hash of the rendered image can be used almost identically to a tracking cookie by the web server.
Tor Browser has been patched to prompt before returning valid image data to the Canvas APIs. By default, if the site has not been given previous permission to extract canvas image data, then white image data is returned to the Javscript APIs. Third parties are not allowed to extract canvas image data at all.
When browsing, if a prompt appears with a message like that below, it is recommended to select.
This website (github.com) attempted to extract HTML5 canvas image data, which may be used to uniquely identify your computer. Should Tor browser allow this website to extract HTML5 canvas image data?
The Privacy Commissioner of Canada provides a succinct definition of an IP address: 
An Internet Protocol (IP) address is a numerical identification and logical address that is assigned to devices participating in a computer network utilizing the Internet Protocol. Although IP addresses are stored as binary numbers, they are usually displayed in a more human-readable notation, such as 184.108.40.206. The Internet Protocol also has the task of routing data packets between networks, and IP addresses specify the locations of the source and destination nodes in the topology of the routing system.
Internet Service Providers (ISPs) assign or lease IP addresses to individuals and these can be static or dynamic. Static IP addresses have a permanent address that is assigned to the network-connected device such as a firewall or router. Dynamic IP addresses are assigned to network-connected devices on a temporary basis (typically a few months), which is often the case for household customers.
In both cases, the IP address acts as a unique identifier and the ISP may save (meta)data for months or even years. This may include browsing records, time spent online, and any direct connection to Internet services. This is possible because the IP address tells the server where to send a response. So long as the IP address does not change, it is easy for ISPs to monitor when and where a user has connected.
Information Linked to IP Addresses
Knowledge of an IP address can reveal various information about devices, networks or services.
Table: IP Address Information 
|ISP Provider||Personal data might be retrieved if the provider is known. For example, information might be sought on email addresses associated with an IP address, which in turn might relate to requests for subscriber information.|
It is possible to geo-locate an IP address to the country, city and regional level:
Based on the preceding information, it is clear that without privacy or anonymity software, individuals are "browsing naked" on the Internet. While many of the threats in this chapter may be mitigated fully or partially without any special services, this is not the case for the IP address which is often uniquely linked to one person.
This is why projects like Tor were founded, to blur any connection between a user's IP address and the websites that are visited. Similarly, this is why the Whonix ™ platform relies on the Tor network as the foundation for anonymous activities. How Tor works [archive]
|Cross-site Request Forgery [archive]||
|Drive-by Download Attacks||When users visit a compromised website running malicious code,  users are redirected to another site controlled by the attackers. Attackers then run code in the victim's web browser that loads an exploit kit which probes the user's OS, browser and software to find vulnerabilities. Payloads/malware are then downloaded that access personal data, encrypt the computer or other intended criminal activity.|
Session Replay Scripts
You may know that most websites have third-party analytics scripts that record which pages you visit and the searches you make. But lately, more and more sites use “session replay” scripts. These scripts record your keystrokes, mouse movements, and scrolling behavior, along with the entire contents of the pages you visit, and send them to third-party servers. Unlike typical analytics services that provide aggregate statistics, these scripts are intended for the recording and playback of individual browsing sessions, as if someone is looking over your shoulder.
Although full or partial redactions are attempted on passwords, credit card numbers, CVC numbers, and credit card expiry dates, sensitive information was found to leak in many instances, such as: 
- Passwords entered into registration forms.
- Leaking of credit card details on payment pages, even in real time.
- Leaking of specific medical conditions and prescriptions.
Safest Browser Against Exploitation
It is clearly unwise to browse the Internet without a well secured browser, otherwise there is a danger of a browser exploit leading to an infected system. Personally configuring a secure browser is an enormous undertaking requiring expertise and significant trial and error. The safer path is to use Tor Browser -- preferably on a Whonix ™ platform -- since it is already hardened against data leakage.
A significant body of research has already proven Tor Browser's superiority to other browsers where privacy and security are concerned. Further, new and emerging threats like cache attack variants and history data leakage via the Paint API [archive] are often solely defeated by Tor Browser. As noted in the Tor Browser chapter:
Tor Browser is a fork of the Mozilla Firefox web browser. It is developed by The Tor Project and optimized and designed for Tor, anonymity and security.
Features like proxy obedience, state separation, network isolation, anonymity set preservation and a host of others are simply unsupported by other browsers.
In stark contrast to regular browsers, Tor Browser is optimized for anonymity and has a plethora of privacy-enhancing patches and add-ons. With Tor Browser, the user "blends in" and shares the Fingerprint of nearly two million other users, which is advantageous for privacy.
Tor Browser blocks most dangerous technologies by default, but most popular websites like Youtube will still resolve correctly. For media portals which rely on Flash or alternative plugins, the relevant files can be downloaded with special software and then viewed with an open source media player like VLC. Websites should be avoided if they insist on the use of active plugins, see Browser Plugins.
The Media Access Control (MAC) address [archive] is the hardware address of each individual network device. It is sometimes referred to as the Ethernet-ID, Airport-ID, or physical / hardware / adapter address. Standard computer systems may have several physical or virtual network devices. These devices can be bound to a cable (LAN), wireless (WLAN), mobile (GPRS, UMTS) or virtual (VPS) environment, or another setup.
The MAC address serves as a unique identifier for the respective device in a local area network. Unless the computer is infected with malware designed to disclose this identifier, it is neither used nor transmitted on the Internet. Also, an access provider can only see the MAC address if the computer is connected directly to the Internet (for example by a modem), rather than over a router.
Despite the limited risk of disclosure, MAC addresses can be used for tracking purposes by adversaries. For instance, other computers on the local network can potentially log it, which would then provide proof that the user's computer has been connected to a specific network. Moreover, advanced tracking techniques exist that are able to enumerate the MAC address [archive] of a Wi-Fi card in use, by examining its physical characteristics. For these reasons MAC spoofing [archive] should be considered for particular circumstances, like when an untrusted, public network will be used. See the MAC address entry for further information.
Mozilla notes browsing history can leak to the network via: 
- DNS name resolution: See here for a detailed description.
- Server IP address: The server's IP address can currently leak and no interim solution has yet been proposed. However, many websites can share the same IP address, slightly lessening the privacy harm.
- TLS certificate message: The new TLS 1.3 standard addresses the threat of tracking by encrypting the server certificate. Unfortunately in late-2018, only around 6 per cent of all TLS sessions were using TLS 1.3  
- TLS Server Name Indication (SNI): This mechanism allows clients to tell a server the name of the server it is contacting, ensuring the correct certificate is selected. This helps to facilitate secure connections to servers that host multiple virtual servers on the same (single) network address.  Encrypting SNI means network attackers are further stymied in trying to discover a user's browsing history. 
The Transmission Control Protocol (TCP) is a session-layer protocol for transferring data between computers. It is necessary for using Internet protocols like http (www), smtp (email) and ftp. For example, when a computer sends a request for a website, this data is sent within many small TCP packets. In addition to the data request, a TCP packet also contains optional information fields in the header (metadata), such as the TCP timestamp. The timestamp's value is proportional to the current time of the computer and is incremented according to the computer's internal clock.
The timestamp can be used by the client and/or server machine for performance metrics and optimization. However, an Internet server may recognize and track a computer by observing those timestamps. By measuring the clock skew of the timestamps to millisecond precision, an adversary can remotely calculate the individual clock skew profile [archive] for a computer, and determine the system uptime and boot time. These techniques work even if the user has otherwise perfectly anonymized their Internet connections.
The Whonix ™ documentation recommends that TCP timestamps be disabled on the host operating system due to the risk.   Non-Qubes-Whonix ™ and Qubes-Whonix ™ users are already protected from this threat. The clock in Whonix-Workstation ™ (
anon-whonix) does not match the clock on the host and is also set securely by sdwdate over , which results in a slightly different result compared to the more accurate NTP.
Tor users are also being protected from being profiled by TCP timestamps in another way: Tor relays automatically replace the potentially insecure TCP packets with their own.
TLS Session Resumption
Many users are unaware that in the standard browser process, TLS handshakes are abbreviated due to use of key material exchanged in an earlier TLS session; this provides an obvious mechanism to link two TLS sessions together. "TLS session resumption" has received little attention from researchers, even though it enables a new form of tracking. 
A 2018 study of 48 popular browsers and the top one million websites found that an average user with standard settings could be tracked for up to 8 days. If the current draft TLS version 1.3 recommendations are adopted (a session resumption lifetime of 7 days), then 65 per cent of all users in the research data-set could be tracked permanently. Notably, only a handful of browsers defeated this threat with standard settings, including Tor Browser and JonDoBrowser.  
New and emerging threats like these reinforce the stock recommendation to only use Tor Browser in Whonix ™, since Firefox does not protect again TLS session resumption with its default settings. If another browser is used in Whonix-Workstation ™ (discouraged!) then it should be regularly restarted so the TLS cache is cleared. Be aware that session tracking will also be influenced by the TLS configuration of both the chosen browser and server.
Web (Email) Beacons and Banner Ads
A web/email beacon ("webbug") is a technique for tracking persons who read a specific web page or email, including the time it occurred and the details of the connecting device.  Beacons can also capture whether an email was read or forwarded, or if web pages were copied to another site. 
This technique is possible because some emails and web pages are not wholly self-contained. Often content is not provided directly, but instead provided by other servers. When the browser or email client prepares the content for display, usually requests are made to the foreign servers for the additional content. These requests reveal: 
- The IP address of the requesting device.
- The time/date the content was requested.
- Details of the web browser/email client making the request.
- Whether cookies exist that were previously set by the server.
Logically a detailed profile can be built over time if this information is stored by servers and each request is associated with a unique tracking token.
Web Beacons (Webbugs)
If users examine the cookies stored in a standard browser, usually one or more exist that are attached to data miners like doubleclick.com [archive], advertisement.com [archive] or Google [archive], even if those websites have never been visited. This is possible because these enterprises embed "webbugs" on various websites, which plant cookies in the browser and track browsing habits: 
Web bugs are tiny (usually a single pixel) transparent image files on web pages that are used to monitor user's online habits. As cited in a CNET article at the height of the web bug storm, critics claimed the bugs could capture IP addresses or perhaps install "pernicious files" and were therefore more invasive than cookies. The argument revolved around the capability, used or unused, that the bugs could take information given by the user at a selected web site and transfer it to any number of other sites without the user's knowledge or consent. The arguments also included the possibility of the bug's information being aggregated with that of cookies and used to create profiles of specific users' habits, instead of being used as general demographic information.
Webbugs are usually tiny pictures around 1 x 1 pixels in size, making them invisible to the viewer. Webbugs can also be coded into banner ads embedded in a website. The website contains a picture (webbug) that is loaded from a third party server running a statistics service, such as Doubleclick or Google Analytics. The statistics service then sets or edits a cookie in the browser, without the user noticing.
Afterwards, the browser will send this cookie back to the statistics service if/when a new content request is made on a site where the service's webbug is embedded. This means if a service is used on many different or popular websites, it can now track a large proportion of a user's browsing session. If a statistics service were to collaborate with a user's preferred search engine, then this could reveal nearly the entirety of Internet activities. 
It is important to note that the privacy functions of most modern browsers provide an inadequate defense. Optimal protection against webbugs is not achieved by simply employing webbug filters and rejecting cookies and/or deleting them upon browser shutdown. As the IP address is sent to the statistics service with every request, the only effective protection is an anonymization service like Tor.
The same profiling technique via beacons can be utilized with email: 
- Web beacons (tiny images) are embedded in emails with unique identifiers contained in the URL.
- When the email is opened, the email client requests the image.
- The email senders learn when the message was read, and the IP address of the device (or proxy server) that the user went through.
- The same information is gathered each time the email is displayed (opened).
This technique is popular with email marketers, spammers and phishers. It confirms the validity of email addresses, tests whether emails made it past the spam filters, and informs if/when the email is displayed. Detection of these emails by users and mail filters is difficult, and emails do not need to contain advertisements or any other commercial material.
The general advice is to use an email client (like Mozilla Thunderbird) rather than a browser. The downloading of remote images whose URLs are embedded in HTML emails should also be disabled. Alternatively, text-based mail readers are available (like Pine or Mutt) or graphical email clients with text-based HTML capabilities (such as Mulberry), which do not interpret HTML or display images. Plain text email messages close off this attack vector completely because web beacons cannot be embedded; the contents are interpreted as display characters, rather than as embedded HTML code.  
Gratitude is expressed to JonDos [archive] for permission [archive] to use material from their website. (w [archive]) (w [archive])  The DataCollectionTechniques page contains content from the JonDonym documentation DataCollectionTechniques [archive] page.
- https://www.thousandeyes.com/learning/glossary/bgp-border-gateway-protocol [archive]
- https://www.thousandeyes.com/learning/glossary/bgp-route-hijacking [archive]
- Unused prefixes are most often relied upon to avoid identification by the real owner. False prefix announcements can also affect the Routing Information Base of peers, leading to further propogation and impacts on other ASes and the Internet more broadly.
- https://www.thousandeyes.com/learning/glossary/bgp-route-leak [archive]
- https://www.eff.org/deeplinks/2010/05/every-browser-unique-results-fom-panopticlick [archive]
- Supercookie test, hash of canvas fingerprint, screen size and color depth, browser plugin details, time zone, DNT header enabled, HTTP_Accept headers, has of WebGL fingerprint, language, system fonts, platform, user agent, touch support, cookies enabled.
- https://33bits.wordpress.com/about/ [archive]
- https://wiki.mozilla.org/Fingerprinting [archive]
- https://panopticlick.eff.org/browser-uniqueness.pdf [archive]
- https://webtransparency.cs.princeton.edu/webcensus/ [archive]
- This was found in 3 scripts on 67 websites (out of 1 million).
- In Tor Browser, Torbutton reduces the available entropy by quantising AvailWidth and AvailHeight, and setting the actual Width and Height to the values of AvailWidth and AvailHeight.
- Research suggests this is useful for profiling and tracking Internet users, as it reveals 10.5 bits of identifying information [archive] on average. This means only one person in 1,500 shares the same User Agent.
- WebRTC was found to discover local IP address on 715 of the top 1 million websites and was employed mostly by third-party trackers.
- Torbutton automatically disables many types of active content.
- https://blog.torproject.org/effs-panopticlick-and-torbutton [archive]
- Privoxy manipulates cookies and modifies web page data and HTTP headers before the page is rendered.
- https://cseweb.ucsd.edu/~lerner/papers/ccs10-jsc.pdf [archive]
- Cache elements include graphic files (logos, icons, banners, buttons etc.), script files, photographs and HTML pages.
- This means a website can only learn information about itself, and not other websites.
- They also have legitimate functions such as keeping users logged into specific accounts.
- https://en.wikipedia.org/wiki/HTTP_ETag [archive]
- http://cyberlaw.stanford.edu/blog/2011/08/tracking-trackers-microsoft-advertising [archive]
- http://www.popularmechanics.com/technology/security/how-to/a6134/what-are-flash-cookies-and-how-can-you-stop-them/ [archive]
- https://www.ghacks.net/2007/05/04/flash-cookies-explained/ [archive]
- In Linux, LSOs are normally stored in:
- https://en.wikipedia.org/wiki/Flash_cookies [archive]
- https://nakedsecurity.sophos.com/2017/10/30/firefox-takes-a-bite-out-of-the-canvas-super-cookie/ [archive]
- Users should never rely on DNT preferences, since they are rarely respected by industry [archive].
- https://www.digitaltrends.com/computing/history-of-cookies-and-effect-on-privacy/ [archive]
- https://www.bleepingcomputer.com/tutorials/what-is-domain-name-resolution/ [archive]
- Firefox and other browser vendors [archive] are exploring the use of DNS over HTTPS in future releases to address this threat.
- Although DNS records do expire, so adversaries must regularly query this information before the information is lost.
- https://en.wikipedia.org/wiki/Domain_Name_System#Privacy/tracking_issues [archive]
- https://dnsprivacy.org/wiki/display/DP/DNS+Privacy+-+The+Problem [archive]
- Some CDNs embed client subnets in queries from resolvers which allows for geo-location of users.
- Meaning if they are malicious, the user is completely compromised. Only Tor combined with the VPN service will prevent this threat.
- For instance, Cloudflare provides this service as of 2018, yet in recent times (2016) the company was blocking 80 per cent of all Tor exit relays [archive].
- https://dnsprivacy.org/wiki/display/DP/DNS+Privacy+-+The+Solutions [archive]
- https://en.wikipedia.org/wiki/Canvas_element [archive]
- http://randomwalker.info/publications/OpenWPM_1_million_site_tracking_measurement.pdf [archive]
- https://tor.stackexchange.com/questions/4029/html-5-canvas-imagedata-extraction-what-does-it-actually-mean [archive]
- https://www.torproject.org/projects/torbrowser/design/ [archive]
- https://www.priv.gc.ca/en/opc-actions-and-decisions/research/explore-privacy-research/2013/ip_201305/ [archive]
- This technique links the resolution of an IP address to its domain name.
- This might include organizational address, name and phone number.
- This technique displays the path of packets across an IP network.
- ip-check.info returns some false values and confuses TBB users [archive] (w [archive])
- http://worldcomp-proceedings.com/proc/p2016/SAM9734.pdf [archive]
- https://en.wikipedia.org/wiki/Cross-site_scripting#Related_vulnerabilities [archive]
- 82% of malicious sites are hacked legitimate ones.
- https://freedom-to-tinker.com/2017/11/15/no-boundaries-exfiltration-of-personal-data-by-session-replay-scripts/ [archive]
- This includes the usual privacy offenders such as microsoft.com, skype.com and adobe.com, along with various sites providing banking, media, torrenting, educational, telecommunications, forums, shopping, and anti-virus services.
- Reinforcing the perception that the private sector really is a comfortable and principal ally in the surveillance-industrial complex.
- For instance, the EasyList and EasyPrivacy blocking lists that are available in popular extensions. However, they did not block all the major companies at the time of writing.
- http://accc.uic.edu/answer/what-my-ip-address-mac-address [archive]
- https://blog.mozilla.org/security/2018/10/18/encrypted-sni-comes-to-firefox-nightly/ [archive]
- https://blog.mozilla.org/security/2018/10/15/removing-old-versions-of-tls/ [archive]
- At the same time, TLS 1.2 comprised around 93 per cent, while TLS 1.0 and 1.1 comprised around 2 per cent combined.
- https://tools.ietf.org/rfcmarkup?doc=6066#section-3 [archive]
- This feature must be supported by the website in question and will initially only be supported by large Content Distribution Networks [archive].
- Even though TCP timestamps protect against wrapped sequence numbers [archive].
- The disabling of ICMP timestamps is also recommended for the same reason.
- https://arxiv.org/pdf/1810.07304.pdf [archive]
- Since browsers on mobile devices are rarely restarted, this greatly extends the likely tracking period.
- The first beacons were small images.
- https://en.wikipedia.org/wiki/Web_bug [archive]
- https://www.scmagazine.com/cookies-and-web-bugs-and-spyware-oh-my/article/548878/ [archive]
- See here [archive] for further details on actual implementation.
- https://en.wikipedia.org/wiki/Web_bug#Email_web_beacons [archive]
- Users can also disconnect from the Internet before reading any downloaded messages, and then delete them before reconnecting.
- Broken link: https://anonymous-proxy-servers.net/forum/viewtopic.php?p=31220#p31220 [archive]
This is a wiki. Want to improve this page? Help is welcome and volunteer contributions are happily considered! Read, understand and agree to Conditions for Contributions to Whonix ™, then Edit! Edits are held for moderation.
Copyright (C) 2012 - 2019 ENCRYPTED SUPPORT LP. Whonix ™ is a trademark. Whonix ™ is a licensee [archive] of the Open Invention Network [archive]. Unless otherwise noted, the content of this page is copyrighted and licensed under the same Freedom Software license as Whonix ™ itself. (Why?)