Perfomatic: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(52 intermediate revisions by 8 users not shown)
Line 1: Line 1:
= People =
= Summary =
* Ryan Doherty
* Les Orchard
* Laura Thomson
* Alice Nodelman
* Chris Cooper


= Milestones =
The Mozilla graph server is used to understand how multiple performance metrics change over time. It is a web application for creating graphs of performance test results for a user-configurable combination of branch, operating system and machine.
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Server+Software&product=Webtools&component=Graph+Server&target_milestone=0.3&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&resolution=DUPLICATE&resolution=---&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.3 bug list]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&target_milestone=0.4&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= 0.4 bug list]
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&product=Webtools&component=Graph+Server&long_desc_type=substring&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailassigned_to1=1&emailtype1=exact&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailtype2=exact&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= All Bugs]


= Schema Junk =
'''People'''
* [http://wiki.mozilla.org/Perfomatic:Schema_Notes Schema Notes]
* Rob Helmer (rhelmer), Alice Nodelman (anode), Laura Thomson (laura), Chris Howse (chowse)
* [http://people.mozilla.org/~morgamic/perfomatic.png Schema Diagram]
* IRC: [irc://irc.mozilla.org/#perfomatic #perfomatic]
 
'''Bugs'''
* [https://bugzilla.mozilla.org/enter_bug.cgi?product=Webtools&component=Graph%20Server File a bug in Webtools : Graph Server]
* [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=component%3A%22graph%20server%22 open bugs]


= Requirements =
= Requirements =
* [http://wiki.mozilla.org/Perfomatic:Requirements Requirements and use-cases]
* [http://wiki.mozilla.org/Perfomatic:Requirements Requirements and use-cases]


= Servers =
= Architecture =
* [http://graphs.mozilla.org/ Production Server]
* [http://graphs-stage.mozilla.org/ Stage Server]


= Tests =
'''Overview:'''
* [[Perfomatic/Test_Name_Mappings|Test Name Mappings]]
* [[Talos]] creates build
* Talos runs a test
* Sends data from test to:
** bulk.cgi - for multiple data points
** collect.cgi - for 1 data point
* bulk.cgi or collect.cgi input into mysql db
* graphs.mozilla.org/graphs.html
** displays a line graph of the data over time
* Single point on graph is an average(ish) of the tests on that day


= Source Code =
'''Diagrams, etc'''
* HG: http://hg.mozilla.org/index.cgi/graphs/
* [http://wiki.mozilla.org/Perfomatic:Schema_Notes Schema notes]
* CVS: http://lxr.mozilla.org/mozilla/source/webtools/new-graph/ (deprecated)
* [[Media:Graph_server_new_db_schema2.png | DB schema diagram]]
* [[Perfomatic:Rearchitecture | Architecture notes]]
* [http://people.mozilla.org/~morgamic/graph-server-architecture.png Morgamic's architecture diagram]
* [[Perfomatic:SendingData| How data is sent to the graph server]]


= Installation Docs =
= Implementation =
 
* [http://hg.mozilla.org/graphs/ Source code]
* [[Perfomatic:UI | 2010 Interface redesign]]
* [[Perfomatic:API | API]]
* [[Perfomatic/Installation]]
* [[Perfomatic/Installation]]
 
* Tests
= Meetings =
** [[Perfomatic/Test_Name_Mappings|Test Name Mappings]]
* Thursdays @ 11am
** [[Perfomatic/BFT|BFT]]
* [[Perfomatic:Meeting_Notes|Meeting Notes]]
* Servers
* IRC: #perfomatic
** [http://graphs.mozilla.org/ Production Server]
 
** [http://graphs.allizom.org/ Stage Server]
= Infrastructure =
*** [http://graphs-stage2.mozilla.org/graph.html#type=series Series data link]
So, maybe someone can add more to this, but here's morgamic's skewed view of where we should venture:
http://people.mozilla.org/~morgamic/graph-server-architecture.png
 
= Backdrop =
The perfomatic is the Mozilla graph server, and is used to understand how multiple performance metrics change over time.  Grasping these relationships is important to understanding how the addition of multiple features affects all facets of speed and performance -- not just the bubbly marketing interpetation of performance -- the real "stuff that matters" kind of performance.

Latest revision as of 19:09, 11 September 2012

Summary

The Mozilla graph server is used to understand how multiple performance metrics change over time. It is a web application for creating graphs of performance test results for a user-configurable combination of branch, operating system and machine.

People

  • Rob Helmer (rhelmer), Alice Nodelman (anode), Laura Thomson (laura), Chris Howse (chowse)
  • IRC: #perfomatic

Bugs

Requirements

Architecture

Overview:

  • Talos creates build
  • Talos runs a test
  • Sends data from test to:
    • bulk.cgi - for multiple data points
    • collect.cgi - for 1 data point
  • bulk.cgi or collect.cgi input into mysql db
  • graphs.mozilla.org/graphs.html
    • displays a line graph of the data over time
  • Single point on graph is an average(ish) of the tests on that day

Diagrams, etc

Implementation

Retrieved from "https://dev.wikimo.nonprod.webservices.mozgcp.net/index.php?title=Perfomatic&oldid=469537"