You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 16:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Fri Apr 26, 2024 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
156110822560,35sleep10-21swapper/107:05:281
15615322214165,43sleep30-21swapper/307:08:053
1561509210387,9sleep20-21swapper/207:07:462
156194099997,9cyclictest0-21swapper/111:18:261
156194099982,10cyclictest881251-21Softwar~cThread09:43:431
162399950,74rtkit-daemon0-21swapper/007:05:120
156194399953,87cyclictest1653733-21munin-run11:35:022
156194099942,88cyclictest0-21swapper/112:30:541
1561948999219,15cyclictest42-21ksoftirqd/309:50:273
156194399922,87cyclictest0-21swapper/211:53:582
15629272910,8sleep21753-21gnome-shell07:10:272
1561943999183,5cyclictest0-21swapper/207:54:152
1561943999183,5cyclictest0-21swapper/207:54:152
1561940999183,5cyclictest0-21swapper/109:13:011
1561943999082,5cyclictest0-21swapper/209:50:442
1561943999082,5cyclictest0-21swapper/208:48:262
156194099902,6cyclictest0-21swapper/110:11:561
1561940999013,15cyclictest881251-21Softwar~cThread09:01:021
1561935999031,9cyclictest1753-21gnome-shell12:01:440
1561943998981,5cyclictest0-21swapper/212:09:502
1561940998916,15cyclictest26-21ksoftirqd/110:06:121
1561940998914,15cyclictest26-21ksoftirqd/108:20:251
1561943998881,4cyclictest0-21swapper/208:23:342
1561943998880,5cyclictest0-21swapper/209:37:102
1561943998880,5cyclictest0-21swapper/208:56:362
1561943998880,5cyclictest0-21swapper/208:12:482
1561940998816,52cyclictest26-21ksoftirqd/109:47:241
1561940998814,16cyclictest26-21ksoftirqd/109:20:321
1561940998814,15cyclictest26-21ksoftirqd/111:55:001
1561943998780,4cyclictest0-21swapper/209:56:482
1561943998779,5cyclictest0-21swapper/208:05:512
1561940998712,15cyclictest26-21ksoftirqd/108:00:101
1561943998679,4cyclictest0-21swapper/208:32:172
1561943998678,5cyclictest0-21swapper/208:35:332
156194399862,42cyclictest1753-21gnome-shell11:59:232
156194399862,42cyclictest1753-21gnome-shell11:59:232
1561943998579,4cyclictest0-21swapper/208:01:022
156194099853,10cyclictest0-21swapper/112:18:261
156194099852,6cyclictest0-21swapper/110:36:481
1561943998478,4cyclictest0-21swapper/211:24:182
1561943998476,5cyclictest0-21swapper/209:43:172
156194099847,20cyclictest141rcu_preempt08:58:421
1561935998464,5cyclictest13-21ksoftirqd/008:32:480
1561948998313,11cyclictest141rcu_preempt11:49:133
156194399836,71cyclictest881251-21Softwar~cThread12:26:482
156194399832,40cyclictest1753-21gnome-shell08:51:182
156194899822,18cyclictest1753-21gnome-shell08:06:043
1561948998210,12cyclictest141rcu_preempt09:57:593
1561943998274,5cyclictest0-21swapper/210:09:202
156194399822,74cyclictest1753-21gnome-shell11:40:092
156194099828,15cyclictest26-21ksoftirqd/110:25:101
156194099822,16cyclictest1673076-21latency_hist12:30:021
1561940998210,8cyclictest141rcu_preempt08:05:301
1561935998271,7cyclictest1753-21gnome-shell11:36:000
1561935998232,45cyclictest1753-21gnome-shell09:42:560
1561943998174,4cyclictest0-21swapper/210:10:562
156194399812,74cyclictest1753-21gnome-shell12:34:262
156194399812,74cyclictest1753-21gnome-shell10:25:062
156194399812,74cyclictest1753-21gnome-shell09:46:512
156194099813,11cyclictest880726-21firefox08:12:581
156194099812,24cyclictest1653600-21runrttasks11:33:551
1561940998114,55cyclictest26-21ksoftirqd/109:37:491
1561935998120,18cyclictest881251-21Softwar~cThread12:05:210
156194399802,73cyclictest1938-21gsd-housekeepin11:48:122
156194399802,73cyclictest1753-21gnome-shell11:26:192
156194399802,72cyclictest1753-21gnome-shell08:26:472
156194399801,37cyclictest1753-21gnome-shell08:19:002
156194399801,37cyclictest1753-21gnome-shell08:18:592
156194099805,15cyclictest26-21ksoftirqd/109:59:211
156194099802,11cyclictest880726-21firefox12:01:331
1561935998027,46cyclictest1753-21gnome-shell08:50:330
1561948997919,18cyclictest42-21ksoftirqd/309:00:353
1561948997912,11cyclictest141rcu_preempt10:19:183
1561943997971,5cyclictest0-21swapper/209:03:412
1561943997970,6cyclictest127-1kworker/2:1H11:18:262
156194399792,72cyclictest1628668-21grep10:20:252
156194399792,71cyclictest1753-21gnome-shell09:20:592
156194399792,36cyclictest1753-21gnome-shell10:15:062
156194399791,37cyclictest1753-21gnome-shell10:04:562
156194099794,18cyclictest26-21ksoftirqd/112:06:221
156194099792,14cyclictest1661533-21kernelversion11:55:201
156194099792,14cyclictest1661533-21kernelversion11:55:201
1561940997911,16cyclictest141rcu_preempt08:25:041
156194899789,13cyclictest141rcu_preempt12:20:563
156194399782,72cyclictest1753-21gnome-shell09:15:212
156194399782,71cyclictest1753-21gnome-shell07:59:082
156194399782,71cyclictest1670737-21rt-features12:20:302
156194399781,36cyclictest1753-21gnome-shell09:06:462
156194399781,36cyclictest1753-21gnome-shell09:06:452
156194099788,18cyclictest26-21ksoftirqd/108:51:571
156194099783,10cyclictest1753-21gnome-shell10:15:261
156194099782,12cyclictest880726-21firefox12:21:151
1561940997818,54cyclictest881251-21Softwar~cThread09:35:011
1561935997866,7cyclictest1753-21gnome-shell09:34:540
156194899779,12cyclictest141rcu_preempt08:49:313
156194899779,11cyclictest141rcu_preempt08:30:123
156194899778,11cyclictest141rcu_preempt10:12:503
156194399772,71cyclictest1753-21gnome-shell08:42:412
156194399772,71cyclictest1753-21gnome-shell08:42:412
156194399772,70cyclictest1753-21gnome-shell11:35:262
156194399772,35cyclictest1753-21gnome-shell12:11:052
156194099778,15cyclictest141rcu_preempt12:10:211
156194099772,19cyclictest26-21ksoftirqd/111:30:001
156194099772,14cyclictest141rcu_preempt08:45:101
1561940997711,53cyclictest141rcu_preempt08:43:411
1561940997711,53cyclictest141rcu_preempt08:43:411
1561940997710,53cyclictest26-21ksoftirqd/107:55:011
1561940997710,53cyclictest26-21ksoftirqd/107:55:011
1561935997766,7cyclictest1753-21gnome-shell12:35:150
16586292760,7sleep00-21swapper/011:45:340
156194899769,11cyclictest141rcu_preempt10:35:403
1561948997659,5cyclictest42-21ksoftirqd/310:26:543
156194399763,68cyclictest1668590-40lsb_release12:15:222
156194099762,11cyclictest1617895-21sed09:50:231
1561935997626,46cyclictest1753-21gnome-shell10:21:060
1561935997626,46cyclictest1753-21gnome-shell08:38:450
1561935997624,47cyclictest1753-21gnome-shell10:00:590
1561935997621,43cyclictest13-21ksoftirqd/008:43:540
1561935997621,43cyclictest13-21ksoftirqd/008:43:540
1561948997558,5cyclictest42-21ksoftirqd/309:38:463
156194899752,11cyclictest1753-21gnome-shell09:15:223
156194399754,56cyclictest141rcu_preempt09:14:442
156194399752,68cyclictest880726-21firefox12:38:382
156194399751,33cyclictest1753-21gnome-shell10:34:252
156194099759,7cyclictest141rcu_preempt11:20:281
156194099752,49cyclictest1753-21gnome-shell10:00:121
156194099752,10cyclictest1590939-21Indexed~#20940108:33:251
1561940997516,45cyclictest141rcu_preempt08:37:501
1561935997564,7cyclictest1753-21gnome-shell09:10:290
1561935997564,7cyclictest1753-21gnome-shell08:10:150
1561935997563,7cyclictest1753-21gnome-shell12:20:520
1561935997526,45cyclictest1753-21gnome-shell09:07:590
1561935997526,45cyclictest1753-21gnome-shell09:07:590
1561935997524,10cyclictest1753-21gnome-shell08:07:120
1561948997455,6cyclictest42-21ksoftirqd/311:42:153
1561943997466,5cyclictest0-21swapper/210:36:482
156194099742,57cyclictest1753-21gnome-shell11:45:521
156194099742,13cyclictest26-21ksoftirqd/108:15:121
156194099742,13cyclictest26-21ksoftirqd/108:15:121
1561935997422,47cyclictest1753-21gnome-shell11:40:330
1561948997355,5cyclictest42-21ksoftirqd/312:05:153
1561948997354,6cyclictest42-21ksoftirqd/309:10:303
156194399732,66cyclictest1609585-21gunzip09:25:332
1561940997339,30cyclictest1578408-21dpkg07:55:121
156194099733,10cyclictest1753-21gnome-shell09:25:311
156194099732,52cyclictest1657318-21munin-run11:45:011
156194099732,14cyclictest141rcu_preempt09:17:301
1561935997363,5cyclictest13-21ksoftirqd/008:22:500
1561935997323,46cyclictest1753-21gnome-shell09:26:480
156194899729,12cyclictest141rcu_preempt11:38:503
156194399721,66cyclictest1663624-21processes12:00:322
156194099726,8cyclictest141rcu_preempt10:20:101
1561940997264,5cyclictest0-21swapper/109:06:051
1561940997264,5cyclictest0-21swapper/109:06:041
1561935997261,5cyclictest13-21ksoftirqd/007:51:180
1561935997261,5cyclictest13-21ksoftirqd/007:51:180
1561935997221,9cyclictest1753-21gnome-shell09:45:090
156194399713,9cyclictest141rcu_preempt07:50:022
156194099712,7cyclictest0-21swapper/107:49:301
156194099712,14cyclictest141rcu_preempt12:38:571
1561935997151,15cyclictest13-21ksoftirqd/010:17:080
1561935997119,10cyclictest1753-21gnome-shell09:58:250
1561935997119,10cyclictest1753-21gnome-shell09:51:040
156194899702,10cyclictest1753-21gnome-shell08:13:003
1561948997019,10cyclictest1753-21gnome-shell11:20:313
156194899701,64cyclictest42-21ksoftirqd/312:39:103
156194099705,53cyclictest26-21ksoftirqd/110:34:251
156194099703,12cyclictest141rcu_preempt11:35:141
1561935997060,5cyclictest13-21ksoftirqd/011:25:140
1561935997020,45cyclictest1753-21gnome-shell08:01:260
1561935997019,9cyclictest1753-21gnome-shell10:10:520
1561935997014,51cyclictest881251-21Softwar~cThread12:30:160
162399690,28rtkit-daemon0-21swapper/007:57:010
1561948996939,10cyclictest1753-21gnome-shell09:21:203
156194899693,46cyclictest1753-21gnome-shell12:10:253
156194899692,58cyclictest1753-21gnome-shell10:33:273
156194899692,47cyclictest1753-21gnome-shell08:38:083
1561943996918,26cyclictest1644170-21missed_timers11:05:242
1561935996953,6cyclictest13-21ksoftirqd/008:26:440
1561935996952,13cyclictest13-21ksoftirqd/008:58:360
1561935996936,15cyclictest141rcu_preempt09:35:260
1561935996919,9cyclictest1753-21gnome-shell09:18:310
1561935996919,46cyclictest1753-21gnome-shell09:24:520
1561935996912,52cyclictest881251-21Softwar~cThread10:05:450
1561948996859,5cyclictest42-21ksoftirqd/309:25:273
1561948996857,7cyclictest1753-21gnome-shell08:42:333
1561948996857,7cyclictest1753-21gnome-shell08:42:333
1561948996856,7cyclictest1753-21gnome-shell08:26:303
1561935996817,9cyclictest1753-21gnome-shell09:00:570
162399670,9rtkit-daemon1622-21rtkit-daemon10:47:073
1561948996755,8cyclictest1753-21gnome-shell10:05:173
156194399671,41cyclictest1642217-21/usr/sbin/munin11:00:192
1561935996715,48cyclictest1753-21gnome-shell12:14:260
1561935996713,49cyclictest881251-21Softwar~cThread11:59:070
1561935996713,49cyclictest881251-21Softwar~cThread11:59:070
1561948996656,6cyclictest42-21ksoftirqd/307:59:133
1561948996654,8cyclictest1753-21gnome-shell08:20:403
1561948996646,12cyclictest42-21ksoftirqd/311:26:093
1561948996638,23cyclictest1753-21gnome-shell09:40:113
1561948996616,46cyclictest1753-21gnome-shell08:55:423
156194899661,59cyclictest1753-21gnome-shell08:50:273
156194899661,22cyclictest1753-21gnome-shell12:19:043
1561943996610,28cyclictest1645742-21taskset11:10:222
1561935996615,10cyclictest1753-21gnome-shell07:49:510
162399650,11rtkit-daemon1622-21rtkit-daemon10:40:522
1561948996544,13cyclictest42-21ksoftirqd/309:46:483
156194899652,21cyclictest1753-21gnome-shell12:30:463
156194899652,20cyclictest1753-21gnome-shell08:19:133
156194899652,20cyclictest1753-21gnome-shell08:19:123
1561935996557,5cyclictest0-21swapper/012:26:460
156193599654,5cyclictest141rcu_preempt11:22:160
1561935996516,45cyclictest1753-21gnome-shell12:15:190
156194899642,21cyclictest1753-21gnome-shell11:59:073
156194899642,21cyclictest1753-21gnome-shell11:59:073
156194899642,19cyclictest1753-21gnome-shell12:26:043
156194399642,37cyclictest1753-21gnome-shell07:34:172
156194399641,35cyclictest1611729-21sshd09:32:502
1561935996453,7cyclictest1753-21gnome-shell10:35:100
1561935996423,8cyclictest141rcu_preempt08:45:220
162399630,18rtkit-daemon1622-21rtkit-daemon10:48:552
1561948996354,5cyclictest42-21ksoftirqd/308:01:103
1561948996343,12cyclictest42-21ksoftirqd/311:53:283
156194899632,20cyclictest1753-21gnome-shell11:34:153
156194899632,20cyclictest1753-21gnome-shell09:07:003
156194899632,20cyclictest1753-21gnome-shell09:07:003
156194899631,58cyclictest1753-21gnome-shell10:04:533
156194899631,58cyclictest1753-21gnome-shell07:53:023
156194899631,58cyclictest1753-21gnome-shell07:53:023
156194899631,21cyclictest1753-21gnome-shell12:02:573
156194399632,34cyclictest1753-21gnome-shell10:56:242
156193599632,57cyclictest1753-21gnome-shell08:16:250
156193599632,57cyclictest1753-21gnome-shell08:16:240
156193599632,19cyclictest1753-21gnome-shell11:51:590
1561948996245,6cyclictest42-21ksoftirqd/310:23:023
1561948996240,17cyclictest42-21ksoftirqd/309:34:253
156194399622,35cyclictest1753-21gnome-shell10:50:262
156194399622,33cyclictest1753-21gnome-shell07:28:072
156193599629,11cyclictest881251-21Softwar~cThread11:18:450
1561935996252,6cyclictest13-21ksoftirqd/010:25:150
156193599612,7cyclictest141rcu_preempt11:34:320
1561935996127,11cyclictest1069-21runrttasks10:34:310
1561948995844,7cyclictest42-21ksoftirqd/307:48:283
1561948995811,43cyclictest1753-21gnome-shell11:18:413
156194399572,31cyclictest1753-21gnome-shell07:36:032
15720932550,5chrt0-21swapper/307:35:283
1561943995220,27cyclictest1564751-21expr07:15:162
162399470,33rtkit-daemon0-21swapper/011:02:100
1561943994718,25cyclictest1573366-21cstates07:40:132
162399460,32rtkit-daemon0-21swapper/007:41:480
1561940994421,6cyclictest1643274-21cron11:05:001
1561948994322,16cyclictest42-21ksoftirqd/311:00:333
162399420,30rtkit-daemon0-21swapper/107:44:591
1561948994226,11cyclictest1567408-21sshd07:22:513
156194899421,37cyclictest1753-21gnome-shell11:09:493
1561940994218,19cyclictest2962348-21rs:main1
156194899416,16cyclictest1753-21gnome-shell10:53:013
156193599411,37cyclictest0-21swapper/010:45:300
156193599411,15cyclictest881251-21Softwar~cThread07:35:380
1561948994023,12cyclictest438-20systemd-journal07:32:503
1561935994023,13cyclictest1562848-21ntpq07:10:250
1561948993921,13cyclictest1635285-21sh10:40:183
1561948993920,14cyclictest438-20systemd-journal07:15:023
156194399391,34cyclictest1566309-21cut07:20:122
162399380,25rtkit-daemon0-21swapper/110:55:111
162399380,25rtkit-daemon0-21swapper/107:28:231
1561948993823,10cyclictest1645262-21/usr/sbin/munin11:10:183
156193599389,11cyclictest1069-21runrttasks11:14:330
1561935993825,8cyclictest1753-21gnome-shell07:20:090
162399370,26rtkit-daemon0-21swapper/107:15:231
15635002372,31sleep31753-21gnome-shell07:13:323
156194899371,21cyclictest141rcu_preempt07:40:103
156194099376,13cyclictest1563646-21cut07:15:011
1561935993722,11cyclictest1639391-21sed10:50:380
156193599372,10cyclictest1753-21gnome-shell11:06:420
1561935993720,12cyclictest1640701-21wc10:55:210
1561935993710,12cyclictest141rcu_preempt07:19:360
162399360,25rtkit-daemon0-21swapper/111:06:411
162399360,25rtkit-daemon0-21swapper/107:37:251
1561948993612,20cyclictest42-21ksoftirqd/307:27:183
1561940993620,11cyclictest1566339-21cat07:20:121
1561935993614,17cyclictest881251-21Softwar~cThread10:43:130
1561935993612,20cyclictest1569370-21unin-run07:30:000
156194899351,15cyclictest1753-21gnome-shell10:56:413
1561940993422,8cyclictest1635630-21sh10:40:261
1561940993419,11cyclictest1645701-21basename11:10:221
156193599341,29cyclictest1569607-21apt07:30:110
1561940993320,9cyclictest26-21ksoftirqd/107:30:131
1561940993216,12cyclictest1638748-21forks10:50:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional