You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-19 - 15:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6s.osadl.org (updated Wed Jun 19, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3241421030,8sleep11765399cyclictest06:01:101
413921020,4sleep119840-21munin-node03:57:421
413921020,4sleep119840-21munin-node03:57:421
3272591970,3ptp4l241ktimersoftd/100:32:001
1765299914,46cyclictest27152-21apt-get05:10:460
1765299898,44cyclictest5663-21apt-key04:00:350
1765299874,45cyclictest9085-21diskstats02:40:520
1765299823,45cyclictest7871-21hddtemp_smartct01:25:540
1765299815,52cyclictest32284-21python05:16:080
1765299804,41cyclictest16548-21snmp_o5powerctl03:31:080
17652997914,44cyclictest13193-21sh04:10:230
1765299781,44cyclictest197-21systemd-journal03:01:390
1765299771,57cyclictest26978-21ssh05:53:500
1765299771,44cyclictest7116-21ssh04:44:190
1765299764,47cyclictest30593-21apt-get03:50:450
17652997613,36cyclictest845-21runrttasks03:17:200
1765299758,43cyclictest28626-21ssh04:30:330
1765299751,49cyclictest4689-21diskmemload02:50:530
1765299751,43cyclictest20495-21ssh05:01:070
1765299742,49cyclictest15607-21apt-get04:55:460
1765299731,50cyclictest21942-21ssh02:56:080
17652997313,39cyclictest31800-21snmpd01:11:140
3272591720,1ptp4l241ktimersoftd/101:31:151
1765299729,39cyclictest4689-21diskmemload03:28:250
1765299724,45cyclictest538-21diskstats04:35:530
1765299724,44cyclictest4933-21/usr/sbin/munin02:36:200
1765299722,48cyclictest19315-21ssh04:16:500
1765299722,44cyclictest15075-21snmp_o5powerctl05:36:080
1765299721,50cyclictest25957-21ssh03:44:220
1765299714,43cyclictest27895-21apt-get05:55:490
1765299712,51cyclictest31662-21ssh04:33:470
1765299703,44cyclictest16155-21apt-get01:45:440
1765299702,45cyclictest22554-21snmp_o5powerctl04:21:120
1765299701,50cyclictest20574-21ssh05:45:060
1765299701,50cyclictest10779-21ssh04:48:520
17652997011,42cyclictest26063-21ssh05:08:490
1765299693,47cyclictest22921-21hddtemp_smartct02:00:520
1765299693,40cyclictest32387-21/usr/sbin/munin03:11:210
1765299692,50cyclictest28546-21seq03:46:320
17652996910,41cyclictest30430-21ssh03:07:090
1765299685,41cyclictest10141-21apt-get05:30:480
1765299683,41cyclictest31203-21apt-get06:00:500
1765299682,46cyclictest4689-21diskmemload02:45:450
1765299682,46cyclictest24553-21seq02:05:350
1765299681,48cyclictest2174-21seq02:26:200
1765299681,47cyclictest4689-21diskmemload03:59:440
1765299681,47cyclictest4689-21diskmemload03:59:440
17652996813,38cyclictest13832-21sh04:52:060
1765299674,42cyclictest2396-21apt-get05:20:460
1765299672,48cyclictest28459-21seq02:13:360
1765299672,46cyclictest11009-21seq03:25:110
1765299672,45cyclictest31800-21snmpd02:31:120
1765299672,42cyclictest9450-21ssh05:29:360
1765299671,46cyclictest3110-21taskset01:15:320
1765299671,41cyclictest27344-21df00:55:460
17653996615,15cyclictest25-21ksoftirqd/105:40:521
1765299663,37cyclictest25237-21df_inode00:50:470
1765299663,37cyclictest25237-21df_inode00:50:470
1765299661,48cyclictest30902-21seq01:02:540
1765299661,48cyclictest23263-21ssh05:47:370
1765299661,46cyclictest22309-21seq00:43:470
1765299661,46cyclictest19034-21snmp_o5powerctl00:36:070
1765299661,45cyclictest16997-21sh04:15:170
3272591650,1ptp4l241ktimersoftd/105:20:051
1765299653,44cyclictest23876-21python00:46:000
1765299652,47cyclictest13186-21runrttasks01:36:250
1765299652,46cyclictest327-21runrttasks02:24:470
1765299652,46cyclictest10736-21snmp_o5powerctl01:31:120
1765299652,45cyclictest15323-21runrttasks01:41:430
1765299652,44cyclictest31800-21snmpd02:16:000
1765299652,44cyclictest22180-21seq01:59:350
1765299652,43cyclictest20424-21snmp_o5powerctl03:36:120
17652996510,39cyclictest197-21systemd-journal01:22:100
3272591640,1ptp4l241ktimersoftd/105:36:511
1765299641,46cyclictest457-21seq01:06:300
1765299632,44cyclictest19968-21seq01:53:310
17653996217,9cyclictest25-21ksoftirqd/104:05:571
174462624,9sleep00-21swapper/000:33:550
3272591550,3ptp4l30062-21kworker/1:206:00:321
3272591550,3ptp4l20758-21kworker/1:005:50:581
17653995520,9cyclictest25-21ksoftirqd/105:06:151
3272591530,4ptp4l31748-21kworker/1:203:28:131
3272591530,3ptp4l8255-21kworker/1:105:28:341
3272591530,1ptp4l241ktimersoftd/104:25:121
1765399531,12cyclictest35692irq/88-enp1s0-r02:15:491
3272591520,3ptp4l31748-21kworker/1:203:50:491
3272591520,3ptp4l22817-21kworker/1:203:03:321
3272591520,3ptp4l1992-21kworker/1:005:21:401
17653995220,9cyclictest25-21ksoftirqd/103:15:471
17653995218,4cyclictest25-21ksoftirqd/104:18:171
3272591510,3ptp4l8759-21kworker/1:002:52:031
3272591510,3ptp4l17515-21kworker/1:000:35:551
3272591510,3ptp4l11051-21kworker/1:201:35:451
17653995119,4cyclictest25-21ksoftirqd/103:43:441
17653995117,4cyclictest25-21ksoftirqd/105:32:141
17653995116,4cyclictest25-21ksoftirqd/103:36:331
3272591500,1ptp4l241ktimersoftd/104:04:381
3272591500,1ptp4l241ktimersoftd/103:12:331
3272591500,1ptp4l241ktimersoftd/102:40:101
1765399507,10cyclictest25-21ksoftirqd/103:48:341
1765399504,6cyclictest25-21ksoftirqd/104:38:271
1765399500,15cyclictest4689-21diskmemload02:47:031
3272591490,3ptp4l28974-21kworker/1:101:02:521
3272591490,3ptp4l24130-21kworker/1:002:05:371
3272591490,1ptp4l241ktimersoftd/105:02:581
3272591490,1ptp4l241ktimersoftd/104:58:261
3272591490,1ptp4l241ktimersoftd/104:47:261
3272591490,1ptp4l241ktimersoftd/104:43:181
3272591490,1ptp4l241ktimersoftd/104:35:131
3272591490,1ptp4l241ktimersoftd/104:27:541
3272591490,1ptp4l241ktimersoftd/103:25:211
3272591490,1ptp4l241ktimersoftd/102:43:181
17653994916,4cyclictest25-21ksoftirqd/105:14:551
17653994916,4cyclictest25-21ksoftirqd/103:06:341
3272591480,1ptp4l241ktimersoftd/101:09:181
3272591480,1ptp4l241ktimersoftd/100:53:461
3272591480,1ptp4l241ktimersoftd/100:53:461
1765399488,10cyclictest25-21ksoftirqd/104:14:051
1765399488,10cyclictest21482-21ssh02:55:571
1765399486,11cyclictest25-21ksoftirqd/104:51:001
3272591470,1ptp4l241ktimersoftd/103:35:151
3272591470,1ptp4l241ktimersoftd/102:25:091
1765399477,11cyclictest25-21ksoftirqd/101:15:421
17653994714,9cyclictest25-21ksoftirqd/101:41:051
3272591460,1ptp4l241ktimersoftd/105:49:471
3272591460,1ptp4l241ktimersoftd/100:45:541
3272591450,1ptp4l241ktimersoftd/100:41:251
1765399454,9cyclictest25-21ksoftirqd/102:02:241
3272591440,1ptp4l241ktimersoftd/102:27:571
1765399448,11cyclictest25-21ksoftirqd/101:56:021
1765399436,5cyclictest25-21ksoftirqd/102:32:391
1765399436,5cyclictest25-21ksoftirqd/101:22:471
1765399435,6cyclictest25-21ksoftirqd/101:48:211
1765399416,4cyclictest25-21ksoftirqd/101:00:211
1765399415,5cyclictest25-21ksoftirqd/101:13:051
1765399413,8cyclictest25-21ksoftirqd/101:27:091
1765399384,4cyclictest25-21ksoftirqd/102:10:571
1765399376,9cyclictest25-21ksoftirqd/101:53:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional