Creation of download sources

To download share price information of different financial instruments with Stockbrowser, first all sources of where this information should come from must be specified.

First, determine which site offers good information. The more data is displayed on the site the more complete the data that is obtained with Stockbrowser. When performing technical analysis, the more complete the data, the better the analysis.

With the most complete information you can benefit as a technical analysis conducted on the data.

Define the source

When a website from which the data can be collected is selected, add this website to the 'sources_personal.txt', which can be found in the installation directory of Stockbrowser. The following data must be added on one line in the file. Between each parameter a semicolon must be added.

  • Format code: a unique code with the order and layout of the columns of the source page.
  • URL: the URL from which the data must be downloaded. This URL is the page on which the data is displayed.
  • Type: the type of financial product which is displayed on the page. To see which products are available to download, see the table below.
  • Category: the category in which the stocks will be put in Stockbrowser. This category corresponds with one of the categories in Stockbrowser.
  • Page name: the page name is displayed in Stockbrowser. This name is, among others, displayed when a download group is created.
  • Page category: the categories to which the stocks on the page belong. Three categories must be added here: Country, Type and Source (e.g. Netherlands, Share, Skuzet).
  • Currency: the currency in which this stock is registered.
Abreviation Product
S Shares
T Topshares
F Funds
I Indices
O Options
OB Bonds
FU Futures
IN Intrest
M Currency
U Unknown

Define the code format

After one or more rules are added, the format in which the columns are displayed must be added. This new format can be added to the file 'definitions.ini' or 'personal_definitions.ini', which are also available in the installation directory of Stockbrowser.

The 'format code', which has just been described, must be added between checkered hooks ('[' and ']'). This is the first line of the layout description. The next line beneath the first line, the order of the columns must be added. This line starts with 'TabFormatString='. The columns that can be used are:

Symbol Meaning
ASK Ask price
BID Bid price
DATE Date
DATETIME Date and time in one field
DELTA Delta of the day
DELTA% Delta of the day in %
DESCRIPTION Description which is added to the option
EARNINGS Earnings per share
HIGH Day high
HIGH_LOW Day high and low in one field
LAST Last with decimals (required)
LOW Day low
OI Open interest
OPEN Open
OPTIONSTRIKE Option strike price
PREVCLOSE Closing of the last day
PREVDATE Previous date
PREVHIGH Previous day high
PREVLOW Previous day low
PREVOPEN Previous day open
PREVVOLUME Previous day volume
SYMBOL Symbol
SYMBOLYYYYMON Symbol and option strike date
TICKER Ticker
TIME Time
USHIGH Day high with fraction (e.g. 1 1/16)
USLAST Last price with fraction
USLOW Day low with fraction
USOPEN Opening price with fraction
USVOLUME Volume with a comma as thousand seperator
VOLUME Volume

When the order of the columns is clear, the markup of the date and time fields must be added. This can be done by adding the following lines:

  • ‘DateString=’: date markup.
  • ‘TimeString=’: time markup.
  • ‘DateTimeSting=’: date and time markup.
  • ‘DateSeparatorChar=’: date seperator symbol.
  • ‘TimeSeparatorChar=’: time seperator symbol.
  • ‘NoTime=1’: time is removed from DATETIME.

An example of the format is:

[FORMATCODE]
TabFormatString=Symbol;Description;Last;Delta;Delta%;Usvolume;DATE;
DateSeparatorChar=/
DateString=DD/MM/YYYY
Timestring=HH:MM
TimeSeparatorChar=:

The before mentioned format is a simple format, but this will do for most of the download sources. When you have found a more complicated or extended source, you can use following markup parameters:

  • ‘AbsoluteColumns=9,15,21,28,34,40’: When no seperators are used, then use the absolute starting position of the columns.
  • ‘BeginCell=1’: change the <TD>-tag in a semicolon (‘;’).
  • ‘Delimiter=’: the fields are seperated by the given symbol.
  • ‘HasQoutes=1’: all data is between brackets.
  • ‘HasStocks=0’: no sounds when the funds are not found.
  • ‘HomePage=’: the site of which the pages are part.
  • ‘HTMLReplaceString=A;B;C;D;’: replace A with B and C with D, etc. after all HTML-tags are removed. This way, special characters like ë can be changed.
  • ‘IgnoreEOL=0’: Usually, lines are wrapped on <BR> and <TR>-tags. When this code is used, also other line breaks apply.
  • ‘IngoodSection=0
    StartKeyword=CONVERTABLE
    Stopkeyword=WARRANTS’: only use the data between ‘StartKeyword’ and ‘StopKeyword’.
  • ‘MaxFields=’: the maximum number of columns in a line. When this code is used, the 'Minfields' code must also be applied.
  • ‘MinFields=’: the minimum number of columns. Also use 'Maxfields'.
  • ‘MultiField=1’: take the first number when more are available in one field.
  • ‘PostFix=’: always add extra signs at the end of a symbol.
  • ‘QuitOnError=1’: nothing is restored when an error occurs.
  • ‘ReplaceChars=1’: replace ‘/’ and ‘\’ with ‘#’, and ‘-‘ with a white space in the symbol of description.
  • ‘ReplaceString=A;B;C;D;’: replace A with B and C with D, etc. after all HTML-tags are removed. This way, special characters like ë can be changed.
  • ‘SingleLinedate=2
    SingleLineSeparator=;’: date is available in the second column. Columns are seperated with a semicolon.
  • ‘SingleLinedate=2’: the date is the second word on the page. Default, words are seperated with a white space.
  • ‘SingleLinedate=3
    SingleLineSeparator=10,20,30’: the date is available in the third column. The first column counts 10 positions, as do the 2nd and 3rd columns.
  • ‘SkipTrailing=0’: do not remove the white space prior to the data.
  • ‘Strikt=1’: the line is ignored when some error is in the line.
  • ‘UnixFormat=0’: accelerate the parsing.
  • ‘UserAgent=’: identify the account with which the data will be fetched.

Loading of the definitions

At this moment, it is possible to load the new definitions into Stockbrowser. This can be done by opening the application and click in the menu File on Reread Download Sources. The new definitions can now be used to fetch the data from the new download source.

 

© 2009 - 2023 Skuzet. All Rights Reserved.

We use cookies on our website. Some of them are essential for the operation of the site, while others help us to improve this site and the user experience (tracking cookies). You can decide for yourself whether you want to allow cookies or not. Please note that if you reject them, you may not be able to use all the functionalities of the site.