You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 06:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Apr 16, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2050599270,23cyclictest0-21swapper/200:08:212
2050599270,1cyclictest0-21swapper/223:51:002
20510992614,4cyclictest14942-21diskmemload23:18:473
20510992610,15cyclictest18337-21ssh23:53:483
2051099260,2cyclictest6598-21latency_hist22:05:003
20505992622,4cyclictest14942-21diskmemload22:50:532
2050599260,25cyclictest790-21sshd00:28:462
2050599260,25cyclictest0-21swapper/221:28:372
2050599260,1cyclictest0-21swapper/223:06:382
2050599260,0cyclictest0-21swapper/223:00:062
2050599260,0cyclictest0-21swapper/223:00:062
20510992523,1cyclictest0-21swapper/323:13:363
20510992521,3cyclictest0-21swapper/322:52:293
2051099250,25cyclictest0-21swapper/321:10:203
2051099250,24cyclictest31105-21apt-get23:34:423
2051099250,24cyclictest14942-21diskmemload00:39:193
2051099250,24cyclictest0-21swapper/322:34:103
2051099250,22cyclictest0-21swapper/300:08:183
2051099250,1cyclictest0-21swapper/321:51:183
2051099250,1cyclictest0-21swapper/300:26:303
20505992521,3cyclictest0-21swapper/223:43:172
20505992519,5cyclictest3541-21apt-get19:44:412
2050599250,24cyclictest0-21swapper/223:36:312
2050599250,24cyclictest0-21swapper/200:33:052
2050599250,21cyclictest0-21swapper/221:35:552
20501992523,1cyclictest0-21swapper/121:41:491
2050199250,24cyclictest14942-21diskmemload22:37:411
2049899252,22cyclictest13-21ksoftirqd/022:53:080
20510992424,0cyclictest0-21swapper/321:16:243
20510992422,1cyclictest19383-21ssh22:19:063
20510992421,3cyclictest0-21swapper/323:43:173
20510992420,3cyclictest0-21swapper/321:32:393
20510992420,3cyclictest0-21swapper/300:34:243
20510992419,4cyclictest0-21swapper/319:44:413
2051099240,24cyclictest0-21swapper/300:16:223
2051099240,23cyclictest14942-21diskmemload23:45:233
2051099240,23cyclictest0-21swapper/322:20:463
2051099240,23cyclictest0-21swapper/322:09:443
2051099240,23cyclictest0-21swapper/321:39:293
2051099240,1cyclictest14942-21diskmemload23:03:003
2051099240,1cyclictest14942-21diskmemload23:03:003
2051099240,0cyclictest17948-21ssh22:49:373
2051099240,0cyclictest0-21swapper/323:36:313
2051099240,0cyclictest0-21swapper/323:22:293
2051099240,0cyclictest0-21swapper/322:25:023
20505992421,2cyclictest0-21swapper/221:30:062
20505992420,3cyclictest0-21swapper/221:51:232
20505992420,3cyclictest0-21swapper/221:11:092
2050599240,3cyclictest0-21swapper/222:36:322
2050599240,23cyclictest0-21swapper/223:22:292
2050599240,21cyclictest20491-21cyclictest22:12:362
2050599240,1cyclictest14942-21diskmemload00:38:262
2050599240,0cyclictest14942-21diskmemload22:04:522
2050599240,0cyclictest0-21swapper/222:58:532
2050599240,0cyclictest0-21swapper/200:02:072
2050199240,0cyclictest0-21swapper/122:07:191
2050199240,0cyclictest0-21swapper/100:15:231
20498992423,1cyclictest14104-21ssh21:40:570
2049899240,24cyclictest0-21swapper/021:39:270
2049899240,24cyclictest0-21swapper/021:17:210
2049899240,23cyclictest0-21swapper/022:46:170
2049899240,0cyclictest14942-21diskmemload23:59:150
2049899240,0cyclictest14942-21diskmemload23:22:360
20510992318,4cyclictest0-21swapper/300:02:033
20510992316,6cyclictest14919-21latency_hist20:05:003
2051099230,2cyclictest5568-21taskset23:09:113
2051099230,23cyclictest0-21swapper/323:25:513
2051099230,23cyclictest0-21swapper/321:43:083
2051099230,23cyclictest0-21swapper/321:28:503
2051099230,22cyclictest5274-21ssh22:35:253
2051099230,22cyclictest24523-21basename20:25:003
2051099230,22cyclictest10309-21ssh22:40:163
2051099230,1cyclictest452-21perf19:35:003
2051099230,0cyclictest14942-21diskmemload22:58:543
2051099230,0cyclictest14942-21diskmemload00:23:243
20505992323,0cyclictest14942-21diskmemload23:48:072
20505992323,0cyclictest0-21swapper/223:25:512
20505992323,0cyclictest0-21swapper/221:16:242
20505992321,1cyclictest27689-21munin-run19:25:002
20505992320,3cyclictest0-21swapper/223:15:502
20505992319,3cyclictest0-21swapper/221:55:362
2050599230,23cyclictest0-21swapper/221:49:012
2050599230,23cyclictest0-21swapper/200:23:242
2050599230,22cyclictest0-21swapper/223:32:102
2050599230,20cyclictest0-21swapper/222:45:152
2050599230,1cyclictest14942-21diskmemload23:55:182
2050599230,0cyclictest0-21swapper/222:31:532
2050599230,0cyclictest0-21swapper/222:20:462
2050599230,0cyclictest0-21swapper/222:09:442
2050599230,0cyclictest0-21swapper/221:24:562
2050599230,0cyclictest0-21swapper/220:24:432
20501992323,0cyclictest14942-21diskmemload22:51:081
20501992323,0cyclictest14942-21diskmemload21:12:201
20501992323,0cyclictest0-21swapper/123:12:231
20501992323,0cyclictest0-21swapper/123:00:041
20501992323,0cyclictest0-21swapper/123:00:041
20501992323,0cyclictest0-21swapper/100:13:531
20501992321,1cyclictest14298-21ssh23:16:541
20501992321,1cyclictest0-21swapper/123:24:521
20501992321,1cyclictest0-21swapper/121:19:431
20501992321,1cyclictest0-21swapper/100:32:461
20501992320,2cyclictest17612-21ssh22:16:121
20501992320,2cyclictest16073-21ssh23:50:041
2050199231,1cyclictest22-21ksoftirqd/122:45:181
2050199230,22cyclictest3460-21ssh23:05:421
2050199230,22cyclictest32207-21cron22:30:011
2050199230,22cyclictest30094-21ssh00:36:121
2050199230,22cyclictest26092-21ssh21:20:351
2050199230,22cyclictest22361-21sh22:20:031
2050199230,22cyclictest1549-21sh23:36:111
2050199230,0cyclictest0-21swapper/123:57:201
2050199230,0cyclictest0-21swapper/121:36:551
2050199230,0cyclictest0-21swapper/121:34:071
2050199230,0cyclictest0-21swapper/100:07:111
20498992323,0cyclictest0-21swapper/023:44:320
20498992323,0cyclictest0-21swapper/023:34:420
20498992323,0cyclictest0-21swapper/023:06:590
20498992323,0cyclictest0-21swapper/023:02:210
20498992323,0cyclictest0-21swapper/023:02:210
20498992323,0cyclictest0-21swapper/022:36:460
20498992322,1cyclictest0-21swapper/000:10:030
20498992321,1cyclictest25632-21ssh23:29:100
20498992321,1cyclictest13557-21idleruntime-cro00:20:000
20498992320,2cyclictest17539-21ssh23:52:370
2049899230,2cyclictest31776-21ssh00:38:580
2049899230,2cyclictest25899-21sh21:20:170
2049899230,22cyclictest8697-21sh22:08:120
2049899230,22cyclictest8198-21cron21:35:010
2049899230,22cyclictest23356-21sh22:21:370
2049899230,22cyclictest2093-21ssh22:00:380
2049899230,1cyclictest14942-21diskmemload22:12:290
2049899230,0cyclictest0-21swapper/023:15:450
2049899230,0cyclictest0-21swapper/021:48:240
20510992222,0cyclictest0-21swapper/323:55:183
20510992222,0cyclictest0-21swapper/320:09:433
20510992220,2cyclictest0-21swapper/321:55:363
2051099220,4cyclictest313-21systemd-journal20:55:003
2051099220,22cyclictest14942-21diskmemload00:12:173
2051099220,21cyclictest19709-21turbostat20:15:003
2051099220,21cyclictest0-21swapper/319:50:013
2051099220,1cyclictest25899-21apt-get19:24:433
2051099220,1cyclictest20332-21apt-get20:19:433
2051099220,1cyclictest19010-21ssh21:45:443
2051099220,1cyclictest12532-21perf20:00:013
2051099220,1cyclictest0-21swapper/321:21:003
2051099220,1cyclictest0-21swapper/319:14:423
20505992222,0cyclictest15542-21apt-get20:09:432
20505992220,2cyclictest0-21swapper/219:14:412
20505992220,1cyclictest0-21swapper/222:44:212
20505992215,6cyclictest14917-21turbostat.cron20:05:002
2050599220,21cyclictest19713-21latency_hist20:15:002
2050599220,21cyclictest0-21swapper/222:15:412
2050599220,21cyclictest0-21swapper/221:41:172
2050599220,21cyclictest0-21swapper/219:50:012
2050599220,1cyclictest0-21swapper/223:10:562
20501992222,0cyclictest0-21swapper/121:52:541
20501992220,1cyclictest5736-21ntp_states22:04:481
20501992220,1cyclictest0-21swapper/121:05:021
20501992220,1cyclictest0-21swapper/119:44:411
2050199220,22cyclictest19700-21ssh21:46:541
2050199220,21cyclictest1111-21apt-get19:39:431
2050199220,21cyclictest10993-21sh23:45:091
2050199220,21cyclictest10867-21rm22:41:121
2050199220,21cyclictest0-21swapper/123:31:171
2050199220,21cyclictest0-21swapper/122:10:211
2050199220,21cyclictest0-21swapper/121:25:401
2050199220,21cyclictest0-21swapper/100:27:471
2050199220,21cyclictest0-21swapper/100:22:281
2050199220,1cyclictest7877-21sh23:43:181
2050199220,1cyclictest26506-21ssh22:57:051
2050199220,1cyclictest0-21swapper/122:30:111
2050199220,1cyclictest0-21swapper/121:55:101
2050199220,1cyclictest0-21swapper/100:01:561
20498992222,0cyclictest0-21swapper/023:46:350
20498992222,0cyclictest0-21swapper/021:50:540
20498992222,0cyclictest0-21swapper/000:20:250
20498992221,1cyclictest0-21swapper/021:55:120
20498992220,1cyclictest15616-21sh21:10:380
2049899221,0cyclictest8731-21kworker/u8:022:15:240
2049899220,22cyclictest14918-21perf20:05:000
2049899220,22cyclictest0-21swapper/000:00:210
2049899220,21cyclictest8471-21ssh23:10:410
2049899220,21cyclictest5697-21munin-run23:40:000
2049899220,21cyclictest24302-21ssh00:30:060
2049899220,21cyclictest0-21swapper/020:44:420
2049899220,1cyclictest800-21ssh22:31:220
2049899220,1cyclictest62550irq/127-eno100:25:020
2049899220,1cyclictest141rcuc/000:05:050
2049899220,1cyclictest11459-21ssh22:42:060
2049899220,0cyclictest0-21swapper/022:55:040
20510992119,1cyclictest0-21swapper/322:11:303
20510992115,5cyclictest2183-21idleruntime-cro20:45:013
2051099210,21cyclictest0-21swapper/321:09:433
2051099210,20cyclictest0-21swapper/320:49:443
20505992120,1cyclictest9767-21idleruntime-cro21:00:002
20505992120,0cyclictest0-21swapper/219:39:432
20505992115,5cyclictest0-21swapper/220:45:012
2050599210,20cyclictest0-21swapper/220:39:422
2050599210,1cyclictest7334-21cron20:55:002
2050599210,1cyclictest25544-21apt-get20:29:432
2050599210,0cyclictest0-21swapper/200:15:552
20501992121,0cyclictest0-21swapper/120:34:421
20501992121,0cyclictest0-21swapper/120:24:431
20501992120,1cyclictest0-21swapper/119:19:431
2050199210,20cyclictest25899-21apt-get19:24:421
20498992121,0cyclictest0-21swapper/021:25:300
20498992121,0cyclictest0-21swapper/019:29:420
20498992121,0cyclictest0-21swapper/019:24:420
2049899210,21cyclictest0-21swapper/020:49:430
2049899210,0cyclictest23484-21apt-get19:19:430
2049899210,0cyclictest0-21swapper/022:25:340
20510992020,0cyclictest0-21swapper/320:29:433
20510992020,0cyclictest0-21swapper/319:39:433
2051099200,0cyclictest30388-21apt-get20:39:423
2051099200,0cyclictest0-21swapper/320:59:433
20505992020,0cyclictest0-21swapper/221:09:432
20505992018,1cyclictest0-21swapper/219:59:422
2050599200,0cyclictest0-21swapper/220:19:432
2050599200,0cyclictest0-21swapper/219:34:422
20501992020,0cyclictest0-21swapper/121:04:421
20501992020,0cyclictest0-21swapper/120:25:021
20501992020,0cyclictest0-21swapper/120:14:421
20501992018,1cyclictest4551-21apt-get20:50:021
20498992020,0cyclictest0-21swapper/021:04:420
20498992020,0cyclictest0-21swapper/020:39:420
20498992020,0cyclictest0-21swapper/020:34:420
20498992020,0cyclictest0-21swapper/019:39:420
20498992018,1cyclictest7369-21munin-run20:55:000
20498992018,1cyclictest0-21swapper/019:55:010
2049899200,0cyclictest0-21swapper/020:09:430
20510991919,0cyclictest10392-21apt-get21:04:423
2051099191,17cyclictest0-21swapper/319:29:453
20505991919,0cyclictest0-21swapper/221:04:422
20505991917,1cyclictest28291-21apt-get19:29:422
2050599190,18cyclictest27942-21apt-get20:34:422
20501991919,0cyclictest0-21swapper/120:49:441
20501991919,0cyclictest0-21swapper/120:19:431
20501991919,0cyclictest0-21swapper/119:59:421
20498991918,1cyclictest12788-21apt-get21:05:020
20501991817,1cyclictest21087-21apt-get19:14:421
20498991818,0cyclictest0-21swapper/020:29:430
20498991818,0cyclictest0-21swapper/020:19:430
2049899180,18cyclictest0-21swapper/019:34:420
20501991717,0cyclictest0-21swapper/119:29:421
20498991717,0cyclictest22756-21apt-get20:24:430
20498991717,0cyclictest17934-21apt-get20:14:420
20501991614,1cyclictest7709-21apt19:50:011
20498991613,2cyclictest12533-21sendmail-msp20:00:010
2051099150,15cyclictest0-21swapper/319:15:033
2050599152,1cyclictest23900-21taskset19:19:442
20501991512,2cyclictest313-21systemd-journal20:40:011
2051099140,14cyclictest0-21swapper/320:30:543
2051099140,0cyclictest0-21swapper/319:50:383
2050599140,14cyclictest0-21swapper/219:50:132
20501991414,0cyclictest0-21swapper/120:55:011
2050199140,14cyclictest0-21swapper/119:50:051
2050199140,0cyclictest0-21swapper/120:00:141
2050199140,0cyclictest0-21swapper/119:30:031
20498991414,0cyclictest0-21swapper/019:45:390
20498991414,0cyclictest0-21swapper/019:11:110
2049899140,14cyclictest0-21swapper/019:40:170
2049899140,0cyclictest0-21swapper/020:55:460
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional