Engineering Blog

Counting Towards Infinity: Next Generation Data Warehousing (Part I)

In this multipart series, "Counting Toward Infinity", we' ll explore various approximation-based sketches to handle problems encountered in our most expensive queries. Lets start with the technical details of our first sketch: HyperLogLog, a linear time, constant space algorithm for estimating multiset cardinality that Turn uses to efficiently estimate the number of unique records that satisfy a given input query.

Read more

Application Data:

engineering 
path /srv/www/sites/turn-dev.com/dev/repo/build/app 
main_controller app\controllers\Primary 

Request Data:

$_GET
pg 
$_POST
No Data
$_COOKIE
No Data
$_FILES
No Data
$_SERVER
REDIRECT_STATUS 200 
HTTP_HOST turn.stage.elusive-concepts.com 
HTTP_ACCEPT_ENCODING x-gzip, gzip, deflate 
HTTP_USER_AGENT CCBot/2.0 (http://commoncrawl.org/faq/) 
HTTP_ACCEPT text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 
PATH REMOVED 
SERVER_SIGNATURE Apache/2.4.10 (Linux/SUSE) Server at turn.stage.elusive-concepts.com Port 80 
SERVER_SOFTWARE Apache/2.4.10 (Linux/SUSE) 
SERVER_NAME turn.stage.elusive-concepts.com 
SERVER_ADDR 192.168.1.201 
SERVER_PORT 80 
REMOTE_ADDR 54.81.44.140 
DOCUMENT_ROOT /srv/www/sites/turn-dev.com/prod/webroot 
REQUEST_SCHEME http 
CONTEXT_PREFIX  
CONTEXT_DOCUMENT_ROOT /srv/www/sites/turn-dev.com/prod/webroot 
SERVER_ADMIN roger.soucy@elusive-concepts.com 
SCRIPT_FILENAME /srv/www/sites/turn-dev.com/prod/webroot/index.php 
REMOTE_PORT 46242 
REDIRECT_QUERY_STRING pg=3 
REDIRECT_URL /engineering 
GATEWAY_INTERFACE CGI/1.1 
SERVER_PROTOCOL HTTP/1.0 
REQUEST_METHOD GET 
QUERY_STRING pg=3 
REQUEST_URI /engineering?pg=3 
SCRIPT_NAME /index.php 
PATH_INFO /engineering 
PATH_TRANSLATED redirect:/index.php/engineering 
PHP_SELF /index.php/engineering 
REQUEST_TIME_FLOAT 1506099817.364 
REQUEST_TIME 1506099817 

Logs:

Time Data
2017-09-22 17:03:37
Loading Framework...

Events:

Event Data Listeners
APPLICATION >> RUN null 0
APPLICATION >> LOADED null 0
APPLICATION >> HANDOFF null 0
TEMPLATE >> HTML_START "" 0
TEMPLATE >> BEFORE_HTML_END null 1

Errors:

Notice (8) Undefined index: excerpt /srv/www/sites/turn-dev.com/dev/repo/build/tmp/smarty/templates_c/578c0cfa397a97d7d8dd94b26dbc47c9502a9de9.file.index.tpl.php L: 74
Notice (8) Undefined index: excerpt /srv/www/sites/turn-dev.com/dev/repo/build/tmp/smarty/templates_c/578c0cfa397a97d7d8dd94b26dbc47c9502a9de9.file.index.tpl.php L: 74
Notice (8) Undefined index: excerpt /srv/www/sites/turn-dev.com/dev/repo/build/tmp/smarty/templates_c/578c0cfa397a97d7d8dd94b26dbc47c9502a9de9.file.index.tpl.php L: 74
Notice (8) Undefined index: excerpt /srv/www/sites/turn-dev.com/dev/repo/build/tmp/smarty/templates_c/578c0cfa397a97d7d8dd94b26dbc47c9502a9de9.file.index.tpl.php L: 74
Notice (8) Undefined index: excerpt /srv/www/sites/turn-dev.com/dev/repo/build/tmp/smarty/templates_c/578c0cfa397a97d7d8dd94b26dbc47c9502a9de9.file.index.tpl.php L: 74

Benchmarks:

Benchmark Tag Time Comment
execution_time TIMER_START 0.000ms Starting bootstrap...
execution_time TIMER_STOP 87.517ms Debug console render output...