Perfomatic: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(19 intermediate revisions by 6 users not shown)
Line 1: Line 1:
= People =
= Summary =
* Ryan Doherty
* Les Orchard
* Alice Nodelman
* Chris Cooper
* Mark Smith
* Stephen Donner (QA)
* K Lars Lohn


* graphserver@mozilla.com
The Mozilla graph server is used to understand how multiple performance metrics change over time. It is a web application for creating graphs of performance test results for a user-configurable combination of branch, operating system and machine.


= Milestones =
'''People'''
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=1.0&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=exact&email1=&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 1.0 bug list]
* Rob Helmer (rhelmer), Alice Nodelman (anode), Laura Thomson (laura), Chris Howse (chowse)
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.6&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=exact&email1=&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.6 bug list] - done
* IRC: [irc://irc.mozilla.org/#perfomatic #perfomatic]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.5&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=exact&email1=&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.5 bug list] - Done
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.4&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.4 bug list] - Done
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Server+Software&product=Webtools&component=Graph+Server&target_milestone=0.3&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&resolution=DUPLICATE&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.3 bug list] - Done


* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= All Bugs]
'''Bugs'''
* [https://bugzilla.mozilla.org/enter_bug.cgi?product=Webtools&component=Graph%20Server File a bug in Webtools : Graph Server]
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=component%3A%22graph%20server%22 open bugs]


= Architecture Overview =
= Requirements =
* Talos creates build
* [http://wiki.mozilla.org/Perfomatic:Requirements Requirements and use-cases]
 
= Architecture =
 
'''Overview:'''
* [[Talos]] creates build
* Talos runs a test
* Talos runs a test
* Sends data from test to:
* Sends data from test to:
Line 30: Line 27:
* Single point on graph is an average(ish) of the tests on that day
* Single point on graph is an average(ish) of the tests on that day


= Schema Junk =
'''Diagrams, etc'''
* [http://wiki.mozilla.org/Perfomatic:Schema_Notes Schema Notes]
* [http://wiki.mozilla.org/Perfomatic:Schema_Notes Schema notes]
* [http://people.mozilla.org/~morgamic/perfomatic.png Schema Diagram]
* [[Media:Graph_server_new_db_schema2.png | DB schema diagram]]
* [[Perfomatic:Rearchitecture | Architecture notes]]
* [http://people.mozilla.org/~morgamic/graph-server-architecture.png Morgamic's architecture diagram]
* [[Perfomatic:SendingData| How data is sent to the graph server]]


= Requirements =
= Implementation =
* [http://wiki.mozilla.org/Perfomatic:Requirements Requirements and use-cases]


= Servers =
* [http://hg.mozilla.org/graphs/ Source code]
* [http://graphs.mozilla.org/ Production Server]
* [[Perfomatic:UI | 2010 Interface redesign]]
* [http://graphs-stage.mozilla.org/ Stage Server]
* [[Perfomatic:API | API]]
**[http://graphs-stage.mozilla.org/graph.html#type=series Series data link]
 
= Tests =
* [[Perfomatic/Test_Name_Mappings|Test Name Mappings]]
* [[Perfomatic/BFT|BFT]]
 
= Source Code =
* HG: http://hg.mozilla.org/index.cgi/graphs/
* CVS: http://lxr.mozilla.org/mozilla/source/webtools/new-graph/ (deprecated)
 
= Installation Docs =
* [[Perfomatic/Installation]]
* [[Perfomatic/Installation]]
 
* Tests
= Meetings =
** [[Perfomatic/Test_Name_Mappings|Test Name Mappings]]
* Thursdays @ 11am
** [[Perfomatic/BFT|BFT]]
* 1-800-707-2533 (pin 369) or 1-650-215-1282 or 1-650-903-0800
* Servers
** Conferencing Center: x91
** [http://graphs.mozilla.org/ Production Server]
** Conference ID: 300
** [http://graphs.allizom.org/ Stage Server]
* [[Perfomatic:Meeting_Notes|Meeting Notes]]
*** [http://graphs-stage2.mozilla.org/graph.html#type=series Series data link]
* IRC: #perfomatic
 
= Rearchitecture =
 
The current implementation of the graph server database is becoming the bottleneck for improvements. We have created a new database and [[Perfomatic:API | API]] for retrieving data.
 
We are planning on migrating to the new architecture early in Q1.
 
* 1.0 Branch on Mercurial
* [[Perfomatic:Rearchitecture | New Architecture Notes]]
* [[Media:Graph_server_new_db_schema2.png | New DB Schema]]
* [[Perfomatic:API | API]]
* [http://people.mozilla.org/~morgamic/graph-server-architecture.png Morgamic's Proposed Architecture]
* [[Perfomatic:SendingData| Reworking how data to sent to the graph server]]
 
= Backdrop =
The perfomatic is the Mozilla graph server, and is used to understand how multiple performance metrics change over time.  Grasping these relationships is important to understanding how the addition of multiple features affects all facets of speed and performance -- not just the bubbly marketing interpetation of performance -- the real "stuff that matters" kind of performance.

Latest revision as of 19:09, 11 September 2012

Summary

The Mozilla graph server is used to understand how multiple performance metrics change over time. It is a web application for creating graphs of performance test results for a user-configurable combination of branch, operating system and machine.

People

  • Rob Helmer (rhelmer), Alice Nodelman (anode), Laura Thomson (laura), Chris Howse (chowse)
  • IRC: #perfomatic

Bugs

Requirements

Architecture

Overview:

  • Talos creates build
  • Talos runs a test
  • Sends data from test to:
    • bulk.cgi - for multiple data points
    • collect.cgi - for 1 data point
  • bulk.cgi or collect.cgi input into mysql db
  • graphs.mozilla.org/graphs.html
    • displays a line graph of the data over time
  • Single point on graph is an average(ish) of the tests on that day

Diagrams, etc

Implementation

Retrieved from "https://dev.wikimo.nonprod.webservices.mozgcp.net/index.php?title=Perfomatic&oldid=469537"