Perfomatic: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(29 intermediate revisions by 8 users not shown)
Line 1: Line 1:
= People =
= Summary =
* Ryan Doherty
* Les Orchard
* Alice Nodelman
* Chris Cooper
* Mark Smith
* Stephen Donner (QA)


* graphserver@mozilla.com
The Mozilla graph server is used to understand how multiple performance metrics change over time. It is a web application for creating graphs of performance test results for a user-configurable combination of branch, operating system and machine.


= Milestones =
'''People'''
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.6&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=exact&email1=&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.6 bug list]
* Rob Helmer (rhelmer), Alice Nodelman (anode), Laura Thomson (laura), Chris Howse (chowse)
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.5&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=exact&email1=&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.5 bug list] - Done
* IRC: [irc://irc.mozilla.org/#perfomatic #perfomatic]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.4&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.4 bug list] - Done
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Server+Software&product=Webtools&component=Graph+Server&target_milestone=0.3&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&resolution=DUPLICATE&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.3 bug list] - Done


* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= All Bugs]
'''Bugs'''
* [https://bugzilla.mozilla.org/enter_bug.cgi?product=Webtools&component=Graph%20Server File a bug in Webtools : Graph Server]
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=component%3A%22graph%20server%22 open bugs]


= Architecture Overview =
= Requirements =
* Talos creates build
* [http://wiki.mozilla.org/Perfomatic:Requirements Requirements and use-cases]
 
= Architecture =
 
'''Overview:'''
* [[Talos]] creates build
* Talos runs a test
* Talos runs a test
* Sends data from test to:
* Sends data from test to:
Line 28: Line 27:
* Single point on graph is an average(ish) of the tests on that day
* Single point on graph is an average(ish) of the tests on that day


= Schema Junk =
'''Diagrams, etc'''
* [http://wiki.mozilla.org/Perfomatic:Schema_Notes Schema Notes]
* [http://wiki.mozilla.org/Perfomatic:Schema_Notes Schema notes]
* [http://people.mozilla.org/~morgamic/perfomatic.png Schema Diagram]
* [[Media:Graph_server_new_db_schema2.png | DB schema diagram]]
 
* [[Perfomatic:Rearchitecture | Architecture notes]]
= Requirements =
* [http://people.mozilla.org/~morgamic/graph-server-architecture.png Morgamic's architecture diagram]
* [http://wiki.mozilla.org/Perfomatic:Requirements Requirements and use-cases]
* [[Perfomatic:SendingData| How data is sent to the graph server]]
 
= Servers =
* [http://graphs.mozilla.org/ Production Server]
* [http://graphs-stage.mozilla.org/ Stage Server]
**[http://graphs-stage.mozilla.org/graph.html#type=series Series data link]  
 
= Tests =
* [[Perfomatic/Test_Name_Mappings|Test Name Mappings]]
* [[Perfomatic/BFT|BFT]]


= Source Code =
= Implementation =
* HG: http://hg.mozilla.org/index.cgi/graphs/
* CVS: http://lxr.mozilla.org/mozilla/source/webtools/new-graph/ (deprecated)


= Installation Docs =
* [http://hg.mozilla.org/graphs/ Source code]
* [[Perfomatic:UI | 2010 Interface redesign]]
* [[Perfomatic:API | API]]
* [[Perfomatic/Installation]]
* [[Perfomatic/Installation]]
 
* Tests
= Meetings =
** [[Perfomatic/Test_Name_Mappings|Test Name Mappings]]
* Thursdays @ 11am
** [[Perfomatic/BFT|BFT]]
* 1-800-707-2533 (pin 369) or 1-650-215-1282 or 1-650-903-0800
* Servers
** Conferencing Center: x91
** [http://graphs.mozilla.org/ Production Server]
** Conference ID: 300
** [http://graphs.allizom.org/ Stage Server]
* [[Perfomatic:Meeting_Notes|Meeting Notes]]
*** [http://graphs-stage2.mozilla.org/graph.html#type=series Series data link]
* IRC: #perfomatic
 
= Rearchitecture =
* [[Perfomatic:Rearchitecture | New Architecture Notes]]
* [[Media:Graph_server_new_db_schema.jpg | New DB Schema]]
* [http://people.mozilla.org/~morgamic/graph-server-architecture.png Morgamic's Proposed Architecture]
 
= Backdrop =
The perfomatic is the Mozilla graph server, and is used to understand how multiple performance metrics change over time.  Grasping these relationships is important to understanding how the addition of multiple features affects all facets of speed and performance -- not just the bubbly marketing interpetation of performance -- the real "stuff that matters" kind of performance.

Latest revision as of 19:09, 11 September 2012

Summary

The Mozilla graph server is used to understand how multiple performance metrics change over time. It is a web application for creating graphs of performance test results for a user-configurable combination of branch, operating system and machine.

People

  • Rob Helmer (rhelmer), Alice Nodelman (anode), Laura Thomson (laura), Chris Howse (chowse)
  • IRC: #perfomatic

Bugs

Requirements

Architecture

Overview:

  • Talos creates build
  • Talos runs a test
  • Sends data from test to:
    • bulk.cgi - for multiple data points
    • collect.cgi - for 1 data point
  • bulk.cgi or collect.cgi input into mysql db
  • graphs.mozilla.org/graphs.html
    • displays a line graph of the data over time
  • Single point on graph is an average(ish) of the tests on that day

Diagrams, etc

Implementation