Perfomatic: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 1: Line 1:
= People=
= Summary =
* Ryan Doherty
* Alice Nodelman
* Chris Cooper
* Stephen Donner (QA)
* K Lars Lohn


* graphserver@mozilla.com
The Mozilla graph server is used to understand how multiple performance metrics change over time. It is a web application for creating graphs of performance test results for a user-configurable combination of branch, operating system and machine.


= Milestones =
'''People'''
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=1.0&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=exact&email1=&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 1.0 bug list]
* Ryan Doherty, Alice Nodelman, Chris Cooper, Stephen Donner (QA), K Lars Lohn
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.6&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=exact&email1=&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.6 bug list] - done
* Bug address: graphserver@mozilla.com
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.5&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=exact&email1=&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.5 bug list] - Done
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.4&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.4 bug list] - Done
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Server+Software&product=Webtools&component=Graph+Server&target_milestone=0.3&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&resolution=DUPLICATE&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.3 bug list] - Done


* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= All Bugs]
'''Bugs'''
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=component%3Agraph%20server open bugs]


= Architecture Overview =
= Requirements =
* [http://wiki.mozilla.org/Perfomatic:Requirements Requirements and use-cases]
 
= Architecture =
 
'''Overview:'''
* Talos creates build
* Talos creates build
* Talos runs a test
* Talos runs a test
Line 28: Line 26:
* Single point on graph is an average(ish) of the tests on that day
* Single point on graph is an average(ish) of the tests on that day


= Schema Junk =
'''Diagrams, etc'''
* [http://wiki.mozilla.org/Perfomatic:Schema_Notes Schema Notes]
* [http://wiki.mozilla.org/Perfomatic:Schema_Notes Schema notes]
* [http://people.mozilla.org/~rdoherty/old-schema.png Schema Diagram]
* [[Media:Graph_server_new_db_schema2.png | DB schema diagram]]
 
* [[Perfomatic:Rearchitecture | Architecture notes]]
= Requirements =
* [http://people.mozilla.org/~morgamic/graph-server-architecture.png Morgamic's architecture diagram]
* [http://wiki.mozilla.org/Perfomatic:Requirements Requirements and use-cases]
* [[Perfomatic:SendingData| How data is sent to the graph server]]


= Servers =
= Implementation =
* [http://graphs.mozilla.org/ Production Server]
* [http://graphs-stage2.mozilla.org/graph.html Stage Server]
**[http://graphs-stage2.mozilla.org/graph.html#type=series Series data link]


= Tests =
* [http://hg.mozilla.org/graphs/ Source code]
* [[Perfomatic/Test_Name_Mappings|Test Name Mappings]]
* [[Perfomatic:API | API]]
* [[Perfomatic/BFT|BFT]]
 
= Source Code =
* HG: http://hg.mozilla.org/index.cgi/graphs/
* CVS: http://lxr.mozilla.org/mozilla/source/webtools/new-graph/ (deprecated)
 
= Installation Docs =
* [[Perfomatic/Installation]]
* [[Perfomatic/Installation]]
* Tests
** [[Perfomatic/Test_Name_Mappings|Test Name Mappings]]
** [[Perfomatic/BFT|BFT]]
* Servers
** [http://graphs.mozilla.org/ Production Server]
** [http://graphs-stage2.mozilla.org/graph.html Stage Server]
*** [http://graphs-stage2.mozilla.org/graph.html#type=series Series data link]


= Meetings =
= Meetings =
Line 58: Line 53:
* [[Perfomatic:Meeting_Notes|Meeting Notes]]
* [[Perfomatic:Meeting_Notes|Meeting Notes]]
* IRC: #perfomatic
* IRC: #perfomatic
= Rearchitecture =
The current implementation of the graph server database is becoming the bottleneck for improvements. We have created a new database and [[Perfomatic:API | API]] for retrieving data.
We are planning on migrating to the new architecture early in Q1.
* Staging server up at: http://graphs-stage2.mozilla.org
* 1.0 Branch on Mercurial
* [[Perfomatic:Rearchitecture | New Architecture Notes]]
* [[Media:Graph_server_new_db_schema2.png | New DB Schema]]
* [[Perfomatic:API | API]]
* [http://people.mozilla.org/~morgamic/graph-server-architecture.png Morgamic's Proposed Architecture]
* [[Perfomatic:SendingData| Reworking how data is sent to the graph server]]
* Will require FF 3.1. We are using the new JSON features for parsing and stringifying.
= Backdrop =
The perfomatic is the Mozilla graph server, and is used to understand how multiple performance metrics change over time.  Grasping these relationships is important to understanding how the addition of multiple features affects all facets of speed and performance -- not just the bubbly marketing interpetation of performance -- the real "stuff that matters" kind of performance.

Revision as of 01:07, 2 March 2010

Summary

The Mozilla graph server is used to understand how multiple performance metrics change over time. It is a web application for creating graphs of performance test results for a user-configurable combination of branch, operating system and machine.

People

  • Ryan Doherty, Alice Nodelman, Chris Cooper, Stephen Donner (QA), K Lars Lohn
  • Bug address: graphserver@mozilla.com

Bugs

Requirements

Architecture

Overview:

  • Talos creates build
  • Talos runs a test
  • Sends data from test to:
    • bulk.cgi - for multiple data points
    • collect.cgi - for 1 data point
  • bulk.cgi or collect.cgi input into mysql db
  • graphs.mozilla.org/graphs.html
    • displays a line graph of the data over time
  • Single point on graph is an average(ish) of the tests on that day

Diagrams, etc

Implementation

Meetings

  • Mondays @ 10am
  • 1-800-707-2533 (pin 369) or 1-650-215-1282 or 1-650-903-0800
    • Conferencing Center: x92
    • Conference ID: 300
  • Meeting Notes
  • IRC: #perfomatic