You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 12:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Aug 28, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1984992523,1cyclictest22290-21ssh23:56:043
1979992523,1cyclictest0-21swapper/223:59:402
1979992523,1cyclictest0-21swapper/222:55:172
197999250,24cyclictest25603-21sh22:04:472
197699252,22cyclictest3036-21fschecks_count23:10:531
197699252,22cyclictest3036-21fschecks_count23:10:531
1976992522,2cyclictest1848-21ssh21:43:261
197699250,24cyclictest19139-21ssh23:54:271
197699250,1cyclictest30874-21sh22:37:581
197699250,1cyclictest0-21swapper/100:26:291
1974992523,1cyclictest24274-21chrt22:02:570
1984992423,1cyclictest26420-21sh22:05:393
1984992423,0cyclictest0-21swapper/322:26:443
1984992422,1cyclictest0-21swapper/322:23:573
198499240,23cyclictest27599-21diskmemload00:11:223
1979992423,1cyclictest27599-21diskmemload22:42:022
197999241,22cyclictest26584-21apt-get22:05:492
197999240,23cyclictest27599-21diskmemload00:10:392
197999240,1cyclictest27599-21diskmemload21:12:572
197999240,1cyclictest17183-21ssh23:23:192
197999240,0cyclictest0-21swapper/221:23:362
197699240,24cyclictest0-21swapper/123:45:071
197699240,24cyclictest0-21swapper/123:17:221
197699240,23cyclictest4454-21ssh22:43:221
197699240,23cyclictest3306-21sh00:38:011
197699240,23cyclictest27599-21diskmemload22:25:581
197699240,1cyclictest27599-21diskmemload22:34:361
197699240,1cyclictest27599-21diskmemload21:49:331
197699240,1cyclictest0-21swapper/122:53:261
1974992423,1cyclictest0-21swapper/021:48:220
1974992422,1cyclictest1105-21apt-get20:15:490
197499240,2cyclictest5831-21ssh21:18:040
197499240,23cyclictest10997-21apt-get22:20:490
197499240,23cyclictest0-21swapper/023:15:120
197499240,1cyclictest27599-21diskmemload21:31:100
197499240,0cyclictest0-21swapper/023:22:280
197499240,0cyclictest0-21swapper/022:54:240
1984992323,0cyclictest27599-21diskmemload21:41:413
1984992323,0cyclictest0-21swapper/323:43:513
1984992323,0cyclictest0-21swapper/321:12:263
198499232,1cyclictest19998-21ssh22:56:113
1984992321,1cyclictest0-21swapper/300:01:383
1984992320,2cyclictest32429-21/usr/sbin/munin00:35:493
198499231,21cyclictest27599-21diskmemload00:32:303
198499231,1cyclictest32503-21rm23:36:093
198499230,23cyclictest0-21swapper/323:22:593
198499230,23cyclictest0-21swapper/322:15:183
198499230,23cyclictest0-21swapper/321:20:443
198499230,23cyclictest0-21swapper/321:15:313
198499230,22cyclictest29018-21sh23:05:093
198499230,22cyclictest27599-21diskmemload00:20:563
198499230,22cyclictest24376-21munin-run21:35:013
198499230,22cyclictest23284-21ntpq22:30:593
198499230,22cyclictest17190-21ssh23:51:523
198499230,22cyclictest12844-21idleruntime-cro20:40:003
198499230,22cyclictest11960-21ssh00:15:593
198499230,22cyclictest11121-21ssh23:17:353
198499230,1cyclictest30463-21ssh22:37:233
198499230,1cyclictest0-21swapper/322:54:593
198499230,0cyclictest0-21swapper/323:00:203
198499230,0cyclictest0-21swapper/322:49:003
1979992323,0cyclictest27599-21diskmemload22:16:202
1979992323,0cyclictest0-21swapper/222:26:322
1979992323,0cyclictest0-21swapper/221:18:532
1979992323,0cyclictest0-21swapper/200:29:102
1979992321,1cyclictest15009-21ssh22:52:362
1979992321,1cyclictest0-21swapper/223:11:312
1979992321,1cyclictest0-21swapper/223:11:312
1979992321,1cyclictest0-21swapper/223:00:502
1979992321,1cyclictest0-21swapper/222:30:532
1979992320,0cyclictest0-21swapper/222:10:082
197999230,3cyclictest0-21swapper/221:36:462
197999230,2cyclictest30251-21ssh00:33:092
197999230,2cyclictest12972-21ssh21:53:222
197999230,2cyclictest10922-21ssh22:20:452
197999230,23cyclictest0-21swapper/222:47:272
197999230,22cyclictest0-21swapper/221:05:492
197999230,22cyclictest0-21swapper/200:06:592
197999230,1cyclictest27599-21diskmemload23:25:562
197999230,1cyclictest12854-21munin-run23:20:012
197999230,0cyclictest0-21swapper/221:55:062
197999230,0cyclictest0-21swapper/221:30:402
1976992323,0cyclictest27599-21diskmemload22:24:571
1976992323,0cyclictest0-21swapper/123:28:411
1976992323,0cyclictest0-21swapper/122:55:331
1976992323,0cyclictest0-21swapper/100:10:501
1976992322,1cyclictest5939-21apt-get20:25:491
1976992322,1cyclictest27599-21diskmemload21:27:561
1976992321,1cyclictest2269-21apt-get19:10:481
1976992321,1cyclictest2269-21apt-get19:10:481
1976992321,1cyclictest15745-21apt-get00:20:491
1976992321,1cyclictest0-21swapper/121:15:001
197699231,21cyclictest25634-21sh00:00:231
197699230,2cyclictest22047-21sh21:31:531
197699230,23cyclictest0-21swapper/123:39:161
197699230,23cyclictest0-21swapper/121:10:111
197699230,22cyclictest606-21dbus-daemon21:55:011
197699230,22cyclictest24637-21sh21:35:141
197699230,22cyclictest16798-21ssh23:22:491
197699230,22cyclictest0-21swapper/122:11:001
197699230,0cyclictest0-21swapper/123:55:281
197699230,0cyclictest0-21swapper/123:00:101
197699230,0cyclictest0-21swapper/122:19:271
197699230,0cyclictest0-21swapper/100:16:471
1974992323,0cyclictest27599-21diskmemload22:32:350
1974992323,0cyclictest0-21swapper/023:43:460
1974992323,0cyclictest0-21swapper/023:29:190
1974992323,0cyclictest0-21swapper/023:11:440
1974992323,0cyclictest0-21swapper/023:11:440
1974992323,0cyclictest0-21swapper/021:52:550
1974992323,0cyclictest0-21swapper/021:10:220
1974992323,0cyclictest0-21swapper/000:21:000
1974992321,2cyclictest0-21swapper/023:00:060
1974992321,1cyclictest0-21swapper/022:45:530
1974992321,1cyclictest0-21swapper/021:37:570
1974992321,1cyclictest0-21swapper/000:30:010
1974992320,2cyclictest0-21swapper/021:41:180
197499231,22cyclictest62550irq/127-eno100:10:520
197499231,1cyclictest62550irq/127-eno123:57:150
197499231,0cyclictest0-21swapper/000:29:560
197499230,23cyclictest0-21swapper/023:47:120
197499230,23cyclictest0-21swapper/023:34:140
197499230,23cyclictest0-21swapper/021:56:200
197499230,23cyclictest0-21swapper/000:36:200
197499230,22cyclictest9829-21ssh22:19:330
197499230,22cyclictest28930-21apt-get23:05:020
197499230,22cyclictest18006-21cron20:50:010
197499230,22cyclictest17374-21sh22:55:050
197499230,22cyclictest17147-21ssh21:27:430
197499230,22cyclictest1226-21sh00:06:180
197499230,22cyclictest0-21swapper/019:35:480
197499230,1cyclictest0-21swapper/023:50:220
197499230,0cyclictest0-21swapper/022:07:260
197499230,0cyclictest0-21swapper/000:15:250
1984992222,0cyclictest0-21swapper/321:51:113
1984992222,0cyclictest0-21swapper/300:27:453
1984992221,1cyclictest31134-21apt-get20:10:493
1984992220,2cyclictest29074-21ssh21:39:023
1984992220,1cyclictest0-21swapper/319:55:003
1984992219,2cyclictest14690-21ssh21:55:223
198499220,21cyclictest27599-21diskmemload00:05:473
198499220,21cyclictest13916-21ssh21:25:393
198499220,21cyclictest0-21swapper/323:31:453
198499220,21cyclictest0-21swapper/323:25:283
198499220,21cyclictest0-21swapper/322:10:513
198499220,21cyclictest0-21swapper/322:00:503
198499220,1cyclictest32733-21ssh22:40:043
198499220,1cyclictest27599-21diskmemload21:45:453
198499220,0cyclictest0-21swapper/323:49:183
198499220,0cyclictest0-21swapper/323:12:333
198499220,0cyclictest0-21swapper/323:12:333
1979992222,0cyclictest27599-21diskmemload21:45:362
1979992220,1cyclictest22794-21sh21:00:012
1979992220,1cyclictest18757-21cron19:45:002
1979992220,1cyclictest0-21swapper/223:45:422
1979992220,1cyclictest0-21swapper/222:37:352
1979992220,1cyclictest0-21swapper/221:40:512
1979992220,1cyclictest0-21swapper/200:15:452
1979992219,2cyclictest247802sleep223:30:492
197999220,21cyclictest27599-21diskmemload23:50:432
197999220,21cyclictest19086-21apt-get19:45:492
197999220,21cyclictest11570-21munin-run19:30:012
197999220,21cyclictest0-21swapper/223:35:182
197999220,21cyclictest0-21swapper/223:08:382
197999220,21cyclictest0-21swapper/221:26:462
197999220,1cyclictest30199-21ssh00:04:212
197999220,1cyclictest27599-21diskmemload00:22:422
197999220,1cyclictest23548-21cron19:55:002
197999220,1cyclictest0-21swapper/223:40:372
1976992221,1cyclictest0-21swapper/120:45:021
1976992220,1cyclictest20539-21ssh22:00:081
197699220,21cyclictest24501-21ssh23:30:271
197699220,21cyclictest0-21swapper/121:55:121
197699220,21cyclictest0-21swapper/121:20:151
197699220,21cyclictest0-21swapper/100:05:511
197699220,1cyclictest30509-21ssh22:08:531
197699220,1cyclictest0-21swapper/123:42:151
197699220,1cyclictest0-21swapper/120:40:001
197499220,2cyclictest1252-21ssh23:37:480
197499220,22cyclictest20833-21sh22:29:210
197499220,21cyclictest0-21swapper/019:10:480
197499220,21cyclictest0-21swapper/019:10:480
197499220,21cyclictest0-21swapper/000:00:510
197499220,1cyclictest7696-21ssh21:20:200
197499220,1cyclictest31295-21ssh22:38:250
197499220,1cyclictest0-21swapper/022:40:260
1979992120,1cyclictest8333-21apt-get20:30:482
197999210,0cyclictest0-21swapper/219:15:492
1976992120,0cyclictest25542-21apt-get21:05:491
1976992119,1cyclictest9169-21munin-run19:25:011
1976992119,1cyclictest797-21munin-run20:15:011
1976992118,2cyclictest16384-21awk19:40:001
197699210,21cyclictest0-21swapper/123:05:131
197699210,0cyclictest0-21swapper/120:15:491
1974992119,2cyclictest62550irq/127-eno120:25:500
197499210,20cyclictest0-21swapper/021:05:490
197499210,20cyclictest0-21swapper/020:50:500
197499210,0cyclictest0-21swapper/021:00:500
197499210,0cyclictest0-21swapper/019:40:490
1984992020,0cyclictest0-21swapper/320:45:023
1984992020,0cyclictest0-21swapper/320:30:493
1984992020,0cyclictest0-21swapper/320:05:493
1984992019,1cyclictest11876-21apt-get19:30:483
1984992018,1cyclictest27608-21ls21:10:003
198499200,0cyclictest0-21swapper/319:45:493
1979992019,0cyclictest0-21swapper/219:55:482
1979992018,1cyclictest20394-21idleruntime-cro20:55:012
197999200,0cyclictest0-21swapper/221:00:492
197999200,0cyclictest0-21swapper/220:35:492
197999200,0cyclictest0-21swapper/220:15:492
197999200,0cyclictest0-21swapper/220:00:482
197999200,0cyclictest0-21swapper/219:10:482
197999200,0cyclictest0-21swapper/219:10:482
1976992020,0cyclictest9480-21apt-get19:25:481
1976992020,0cyclictest0-21swapper/119:55:481
197699200,1cyclictest0-21swapper/120:50:501
197699200,0cyclictest0-21swapper/120:30:491
1974992020,0cyclictest0-21swapper/019:50:480
1974992019,1cyclictest0-21swapper/019:30:480
197499200,0cyclictest10732-21apt-get20:35:490
1984991919,0cyclictest0-21swapper/320:15:493
1984991918,1cyclictest11564-21awk19:30:013
1976991919,0cyclictest0-21swapper/120:20:491
1976991919,0cyclictest0-21swapper/119:45:491
1976991918,0cyclictest21477-21apt-get19:50:481
1974991917,1cyclictest0-21swapper/020:45:000
1984991818,0cyclictest23146-21apt-get21:00:493
1984991818,0cyclictest0-21swapper/320:25:493
1984991818,0cyclictest0-21swapper/320:00:483
1984991816,1cyclictest16380-21sendmail-msp19:40:003
1979991816,1cyclictest5634-21munin-run20:25:002
197999180,3cyclictest18038-21sort20:50:012
197999180,13cyclictest0-21swapper/219:35:482
1974991818,0cyclictest0-21swapper/020:20:490
1976991717,0cyclictest0-21swapper/120:40:501
1976991717,0cyclictest0-21swapper/119:15:491
1974991717,0cyclictest19086-21apt-get19:45:490
1974991717,0cyclictest0-21swapper/019:20:490
1984991616,0cyclictest0-21swapper/320:20:493
1984991616,0cyclictest0-21swapper/319:55:483
1984991616,0cyclictest0-21swapper/319:40:493
1984991616,0cyclictest0-21swapper/319:15:493
1979991615,0cyclictest0-21swapper/219:20:492
197699162,13cyclictest18760-21awk19:45:001
197699160,15cyclictest0-21swapper/120:55:511
1974991616,0cyclictest23874-21apt-get19:55:480
1974991615,1cyclictest4666-21apt-get19:15:490
1984991515,0cyclictest0-21swapper/320:40:503
198499150,0cyclictest0-21swapper/319:10:483
198499150,0cyclictest0-21swapper/319:10:483
197999150,0cyclictest0-21swapper/220:42:452
197699150,1cyclictest26289-21apt-get20:00:481
197499153,10cyclictest313-21systemd-journal20:09:450
198499140,14cyclictest0-21swapper/320:55:203
198499140,14cyclictest0-21swapper/319:20:463
198499140,0cyclictest0-21swapper/320:50:273
197999140,14cyclictest0-21swapper/220:26:012
197999140,14cyclictest0-21swapper/220:05:392
197999140,0cyclictest0-21swapper/220:10:112
1976991414,0cyclictest0-21swapper/119:30:521
197699140,14cyclictest0-21swapper/121:00:271
197699140,14cyclictest0-21swapper/120:05:181
1974991414,0cyclictest0-21swapper/020:30:410
1974991414,0cyclictest0-21swapper/019:25:070
197499140,0cyclictest0-21swapper/020:55:060
197499140,0cyclictest0-21swapper/020:10:250
197499140,0cyclictest0-21swapper/020:00:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional