You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 09:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Sun May 24, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1729199290,0cyclictest0-21swapper/000:02:540
17291992723,3cyclictest10872-21diskmemload21:45:320
1729199270,23cyclictest22191-21rm22:45:530
1729199270,1cyclictest12353-21basename21:40:000
1730099260,1cyclictest0-21swapper/200:28:302
17291992620,5cyclictest10872-21diskmemload21:17:580
1729199260,21cyclictest26216-21apt-get23:47:550
1729199260,1cyclictest30141-21ssh00:19:100
1729199260,1cyclictest18132-21ssh00:08:050
1729199260,1cyclictest14842-21ssh00:33:530
1730199250,24cyclictest10872-21diskmemload21:37:133
1730199250,1cyclictest0-21swapper/323:42:553
17300992520,4cyclictest0-21swapper/221:22:312
1730099250,24cyclictest0-21swapper/200:34:002
1730099250,1cyclictest0-21swapper/223:28:502
1729599250,24cyclictest0-21swapper/123:09:551
1729599250,24cyclictest0-21swapper/121:47:381
1729599250,0cyclictest0-21swapper/122:47:091
17291992520,4cyclictest30814-21rm21:56:460
17291992520,4cyclictest10872-21diskmemload22:50:450
1729199250,24cyclictest9676-21munin-run00:30:010
1729199250,24cyclictest12146-21ssh21:11:260
1729199250,24cyclictest10872-21diskmemload23:16:500
1729199250,24cyclictest10872-21diskmemload22:11:460
1729199250,24cyclictest10872-21diskmemload00:21:230
1729199250,23cyclictest0-21swapper/021:21:350
1729199250,21cyclictest19661-21ssh23:41:320
1729199250,1cyclictest459-21ssh21:29:190
1729199250,1cyclictest17508-21sh21:44:170
1729199250,1cyclictest10985-21ssh23:04:420
1729199250,1cyclictest10872-21diskmemload23:52:080
1729199250,1cyclictest0-21swapper/022:33:540
17301992424,0cyclictest0-21swapper/321:47:533
1730199240,23cyclictest10872-21diskmemload22:16:033
1730199240,23cyclictest10872-21diskmemload00:38:533
1730199240,23cyclictest10872-21diskmemload00:26:003
1730199240,23cyclictest0-21swapper/322:14:323
1730199240,0cyclictest0-21swapper/323:56:123
17300992423,1cyclictest0-21swapper/200:35:012
17300992422,1cyclictest0-21swapper/223:21:362
17300992422,1cyclictest0-21swapper/222:31:192
17300992422,1cyclictest0-21swapper/222:19:112
17300992421,2cyclictest783-21snmpd23:40:282
17300992420,4cyclictest0-21swapper/221:45:462
1730099240,23cyclictest5671-21apt23:00:002
1730099240,23cyclictest0-21swapper/221:17:142
1730099240,23cyclictest0-21swapper/200:15:592
1730099240,1cyclictest31841-21apt-get23:52:552
1730099240,1cyclictest14974-21diskmemload23:37:512
17295992423,1cyclictest10872-21diskmemload23:47:231
1729599240,2cyclictest31406-21ssh22:25:051
1729599240,24cyclictest0-21swapper/123:24:381
1729599240,23cyclictest14317-21ssh00:05:061
1729599240,23cyclictest10872-21diskmemload00:32:451
1729599240,23cyclictest0-21swapper/123:57:431
1729599240,23cyclictest0-21swapper/122:20:171
17291992422,2cyclictest0-21swapper/021:30:090
1729199242,1cyclictest62550irq/127-eno123:09:340
17291992420,3cyclictest10872-21diskmemload23:25:530
17291992420,3cyclictest0-21swapper/022:38:300
17291992420,3cyclictest0-21swapper/000:36:270
1729199240,24cyclictest0-21swapper/021:54:150
1729199240,23cyclictest0-21swapper/022:40:160
1729199240,21cyclictest10872-21diskmemload22:05:430
1729199240,20cyclictest19913-21ssh22:15:260
1729199240,1cyclictest3468-21ssh23:55:420
1729199240,1cyclictest32359-21ssh22:26:250
1729199240,0cyclictest13035-21ssh23:35:160
1729199240,0cyclictest10872-21diskmemload22:59:520
1729199240,0cyclictest0-21swapper/023:10:300
1729199240,0cyclictest0-21swapper/000:10:470
17301992323,0cyclictest10872-21diskmemload23:14:373
17301992323,0cyclictest0-21swapper/323:23:003
17301992323,0cyclictest0-21swapper/322:35:103
17301992321,1cyclictest0-21swapper/322:55:433
1730199231,21cyclictest3410-21apt-get21:32:543
1730199230,2cyclictest25891-21sh23:47:233
1730199230,23cyclictest0-21swapper/322:50:593
1730199230,22cyclictest24962-21ssh21:51:253
1730199230,22cyclictest24427-21ssh00:13:593
1730199230,22cyclictest0-21swapper/322:32:593
1730199230,22cyclictest0-21swapper/322:02:133
1730199230,1cyclictest0-21swapper/300:15:553
1730199230,0cyclictest10872-21diskmemload21:20:453
1730199230,0cyclictest10872-21diskmemload21:14:493
1730199230,0cyclictest0-21swapper/323:31:483
1730199230,0cyclictest0-21swapper/322:43:083
1730199230,0cyclictest0-21swapper/321:56:193
17300992323,0cyclictest10872-21diskmemload00:09:332
17300992323,0cyclictest0-21swapper/223:19:172
17300992323,0cyclictest0-21swapper/222:23:022
17300992323,0cyclictest0-21swapper/222:13:192
17300992323,0cyclictest0-21swapper/221:43:142
17300992321,1cyclictest0-21swapper/223:55:452
17300992321,1cyclictest0-21swapper/223:11:002
17300992321,1cyclictest0-21swapper/221:58:002
1730099230,2cyclictest28894-21idleruntime-cro20:40:002
1730099230,23cyclictest0-21swapper/223:32:522
1730099230,23cyclictest0-21swapper/221:53:262
1730099230,22cyclictest783-21snmpd21:11:082
1730099230,22cyclictest4017-21awk00:25:012
1730099230,22cyclictest3564-21ssh22:01:102
1730099230,22cyclictest24929-21diskmemload23:46:122
1730099230,22cyclictest10865-21cron21:10:012
1730099230,1cyclictest0-21swapper/223:00:182
1730099230,0cyclictest29277-21apt-get22:52:552
1730099230,0cyclictest10872-21diskmemload21:28:422
17295992323,0cyclictest10872-21diskmemload21:31:221
17295992323,0cyclictest0-21swapper/122:59:281
17295992323,0cyclictest0-21swapper/121:36:411
17295992323,0cyclictest0-21swapper/121:19:311
17295992321,1cyclictest9413-21ssh22:06:301
17295992321,1cyclictest18914-21perf20:20:011
17295992321,1cyclictest0-21swapper/122:50:461
17295992320,2cyclictest23256-21sh23:15:411
17295992320,2cyclictest15204-21ssh21:13:131
1729599230,23cyclictest0-21swapper/122:19:061
1729599230,22cyclictest25513-21ssh00:15:131
1729599230,22cyclictest11546-21rm22:36:491
1729599230,1cyclictest8930-21ssh23:32:181
1729599230,0cyclictest10872-21diskmemload23:40:371
1729599230,0cyclictest10872-21diskmemload23:10:331
1729599230,0cyclictest0-21swapper/123:01:011
1729599230,0cyclictest0-21swapper/121:55:211
1729599230,0cyclictest0-21swapper/121:40:501
17291992323,0cyclictest0-21swapper/023:32:440
1729199231,21cyclictest3671-21sh20:55:000
1729199230,23cyclictest10872-21diskmemload23:20:070
1729199230,1cyclictest28852-21/usr/sbin/munin22:23:030
1729199230,0cyclictest0-21swapper/022:01:180
17301992222,0cyclictest0-21swapper/322:20:373
17301992220,1cyclictest0-21swapper/323:50:013
17301992220,1cyclictest0-21swapper/323:25:503
17301992220,1cyclictest0-21swapper/300:20:183
17301992220,0cyclictest151rcu_preempt22:45:243
1730199220,21cyclictest26483-21latency_hist20:35:003
1730199220,21cyclictest19595-21perf00:10:003
1730199220,21cyclictest0-21swapper/323:36:233
1730199220,21cyclictest0-21swapper/322:25:353
1730199220,21cyclictest0-21swapper/321:25:213
1730199220,21cyclictest0-21swapper/321:15:543
1730199220,21cyclictest0-21swapper/300:00:433
1730199220,1cyclictest622-21gdbus20:30:003
1730199220,1cyclictest10872-21diskmemload23:17:243
1730199220,1cyclictest10661-21diskmemload00:30:293
1730199220,1cyclictest0-21swapper/321:40:523
1730199220,0cyclictest0-21swapper/322:05:093
17300992222,0cyclictest10872-21diskmemload00:02:452
17300992222,0cyclictest0-21swapper/222:45:202
17300992222,0cyclictest0-21swapper/222:06:532
17300992221,1cyclictest10872-21diskmemload22:44:302
17300992220,1cyclictest0-21swapper/222:37:582
17300992220,1cyclictest0-21swapper/221:31:152
1730099220,21cyclictest16859-21latency_hist23:10:002
1730099220,21cyclictest0-21swapper/200:10:252
1730099220,1cyclictest0-21swapper/222:29:252
1730099220,1cyclictest0-21swapper/221:35:132
17295992222,0cyclictest0-21swapper/123:35:411
17295992222,0cyclictest0-21swapper/100:00:491
17295992221,1cyclictest0-21swapper/123:51:331
17295992220,2cyclictest20571-21ssh00:39:061
17295992220,1cyclictest2038-21turbostat19:45:001
1729599220,22cyclictest30197-21apt-get21:27:531
1729599220,22cyclictest0-21swapper/122:13:551
1729599220,22cyclictest0-21swapper/121:53:011
1729599220,21cyclictest10872-21diskmemload00:20:431
1729599220,21cyclictest0-21swapper/122:00:371
1729599220,21cyclictest0-21swapper/121:10:011
1729599220,21cyclictest0-21swapper/119:17:531
1729599220,21cyclictest0-21swapper/100:11:421
1729599220,1cyclictest18899-21apt-get20:20:021
1729599220,1cyclictest16649-21ssh22:41:061
1729599220,1cyclictest0-21swapper/123:27:571
1729599220,1cyclictest0-21swapper/122:33:431
1729599220,1cyclictest0-21swapper/121:20:411
1729599220,1cyclictest0-21swapper/100:25:261
17291992215,6cyclictest19533-21apt-get20:20:020
1729199220,21cyclictest29649-21perf19:35:010
1729199220,21cyclictest0-21swapper/020:15:010
1729199220,1cyclictest0-21swapper/019:28:030
17301992119,1cyclictest9238-21turbostat20:00:003
17301992119,1cyclictest29394-21apt-get20:42:543
17301992119,1cyclictest20029-21ls19:15:013
1730199210,21cyclictest10872-21diskmemload23:05:063
1730199210,21cyclictest0-21swapper/323:00:183
1730199210,1cyclictest24841-21cron19:25:013
1730199210,0cyclictest0-21swapper/320:52:533
17300992120,0cyclictest22182-21apt-get20:27:532
17300992120,0cyclictest20518-21apt-get19:17:532
17300992119,1cyclictest27727-21apt-get19:32:542
1730099210,20cyclictest18125-21apt-get19:12:542
1730099210,20cyclictest0-21swapper/219:27:532
17295992121,0cyclictest0-21swapper/120:27:531
17295992121,0cyclictest0-21swapper/119:37:551
17295992121,0cyclictest0-21swapper/119:12:541
17295992120,0cyclictest24582-21apt-get20:32:531
17295992119,1cyclictest14577-21apt-get20:12:561
1729599210,0cyclictest26973-21apt-get20:37:531
17291992121,0cyclictest0-21swapper/020:17:550
17291992119,1cyclictest24831-21idleruntime-cro19:25:010
1729199210,1cyclictest4557-21date19:50:000
1729199210,1cyclictest0-21swapper/021:02:550
1729199210,1cyclictest0-21swapper/019:13:020
1729199210,0cyclictest0-21swapper/020:02:540
17301992020,0cyclictest4918-21apt-get19:52:553
17301992020,0cyclictest0-21swapper/320:12:563
17301992019,1cyclictest19790-21apt-get20:22:543
1730199200,20cyclictest0-21swapper/319:42:553
1730199200,0cyclictest0-21swapper/319:32:543
17300992019,1cyclictest0-21swapper/220:57:532
1730099200,20cyclictest0-21swapper/220:52:532
17295992020,0cyclictest0-21swapper/119:52:551
17295992019,1cyclictest1766-21apt-get20:52:531
17295992018,1cyclictest4433-21awk19:50:001
1729599200,0cyclictest0-21swapper/119:57:551
17291992020,0cyclictest30124-21apt-get19:37:550
17291992018,2cyclictest0-21swapper/020:45:000
1729199200,1cyclictest12125-21apt-get20:07:530
1729199200,1cyclictest0-21swapper/019:45:000
1729199200,0cyclictest8641-21systemctl19:58:030
1729199200,0cyclictest0-21swapper/020:47:540
1729199200,0cyclictest0-21swapper/020:37:540
17300991919,0cyclictest16972-21apt-get20:17:552
17300991919,0cyclictest0-21swapper/220:12:562
17300991919,0cyclictest0-21swapper/219:47:552
17295991919,0cyclictest25329-21apt-get19:27:531
17295991918,1cyclictest0-21swapper/120:07:531
17295991917,1cyclictest8475-21cron21:05:011
17291991919,0cyclictest0-21swapper/020:57:120
1729199190,1cyclictest0-21swapper/020:26:470
1729199190,0cyclictest0-21swapper/020:32:530
17301991818,0cyclictest0-21swapper/320:37:543
17301991816,1cyclictest11656-21munin-run20:05:003
17300991818,0cyclictest0-21swapper/221:02:552
17300991818,0cyclictest0-21swapper/219:57:552
17300991818,0cyclictest0-21swapper/219:22:542
17300991816,1cyclictest0-21swapper/220:42:542
1730099180,0cyclictest0-21swapper/220:22:542
17295991818,0cyclictest22935-21apt-get19:22:541
17295991818,0cyclictest0-21swapper/120:50:001
17295991818,0cyclictest0-21swapper/120:42:541
17295991816,1cyclictest606-21dbus-daemon19:35:011
17301991717,0cyclictest0-21swapper/319:37:553
17301991716,1cyclictest0-21swapper/319:47:553
17301991715,1cyclictest14081-21cron20:10:013
17295991716,1cyclictest9732-21apt-get20:02:541
17295991715,1cyclictest1-21systemd21:00:011
17291991717,0cyclictest0-21swapper/019:52:550
17301991616,0cyclictest0-21swapper/319:27:533
17301991615,0cyclictest0-21swapper/320:17:553
1730099160,15cyclictest30642-21tune2fs19:37:572
1730099160,15cyclictest10369-21gltestperf20:02:562
1729199160,15cyclictest0-21swapper/021:10:010
17301991414,0cyclictest0-21swapper/321:05:013
17301991414,0cyclictest0-21swapper/321:01:063
1730199140,14cyclictest0-21swapper/320:56:283
1730199140,14cyclictest0-21swapper/319:16:433
1730199140,0cyclictest0-21swapper/320:45:043
1730099140,14cyclictest0-21swapper/220:47:152
1730099140,14cyclictest0-21swapper/219:41:232
1730099140,0cyclictest0-21swapper/219:50:522
1730099130,0cyclictest0-21swapper/220:31:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional