You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 06:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sat Jul 11, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11938992523,1cyclictest9037-21ssh23:35:473
1193899250,24cyclictest0-21swapper/321:21:403
1193699250,24cyclictest0-21swapper/223:33:152
1193699250,24cyclictest0-21swapper/200:06:532
11931992523,1cyclictest313-21systemd-journal19:50:001
1193199250,25cyclictest0-21swapper/100:26:191
1193199250,24cyclictest9365-21ssh23:36:111
1193199250,24cyclictest32243-21sh21:32:221
1193199250,1cyclictest26772-21ssh22:53:081
11927992523,1cyclictest28898-21runrttasks23:24:220
11927992523,1cyclictest28821-21wc23:52:010
1192799250,1cyclictest5339-21awk22:35:010
1192799250,1cyclictest0-21swapper/022:26:070
11938992423,1cyclictest0-21swapper/323:25:073
11938992423,0cyclictest0-21swapper/322:38:503
11938992422,1cyclictest25943-21apt-get21:56:513
1193899240,2cyclictest23178-21idleruntime-cro20:40:003
1193899240,24cyclictest0-21swapper/321:11:263
1193899240,23cyclictest5582-21diskmemload00:26:373
1193899240,23cyclictest23811-21idleruntime-cro23:20:013
1193899240,23cyclictest0-21swapper/322:40:193
1193899240,23cyclictest0-21swapper/322:05:133
1193899240,23cyclictest0-21swapper/321:51:373
1193899240,23cyclictest0-21swapper/321:30:453
1193899240,23cyclictest0-21swapper/300:35:173
1193899240,23cyclictest0-21swapper/300:06:533
11936992423,1cyclictest0-21swapper/221:21:512
11936992423,0cyclictest29760-21ssh23:25:072
1193699240,23cyclictest5582-21diskmemload23:48:422
1193699240,23cyclictest5582-21diskmemload21:40:532
1193699240,23cyclictest0-21swapper/223:59:242
1193699240,23cyclictest0-21swapper/223:59:242
1193699240,23cyclictest0-21swapper/223:36:562
1193699240,23cyclictest0-21swapper/222:20:132
1193699240,23cyclictest0-21swapper/221:11:262
1193699240,0cyclictest0-21swapper/223:54:192
11931992422,1cyclictest0-21swapper/121:56:551
1193199240,23cyclictest0-21swapper/100:39:551
1193199240,0cyclictest0-21swapper/122:20:571
11927992421,2cyclictest24359-21latency_hist19:35:010
1192799240,23cyclictest19817-21sh21:51:130
1192799240,23cyclictest0-21swapper/023:41:230
1192799240,0cyclictest0-21swapper/000:25:580
11938992323,0cyclictest0-21swapper/323:53:563
11938992323,0cyclictest0-21swapper/323:09:063
11938992321,1cyclictest0-21swapper/322:54:543
1193899230,2cyclictest772-21cron21:00:003
1193899230,2cyclictest7539-21sh00:30:473
1193899230,2cyclictest18922-21interrupts22:46:563
1193899230,23cyclictest0-21swapper/322:20:133
1193899230,22cyclictest5582-21diskmemload22:25:293
1193899230,22cyclictest18165-21sh21:49:213
1193899230,22cyclictest0-21swapper/323:57:553
1193899230,22cyclictest0-21swapper/323:57:553
1193899230,22cyclictest0-21swapper/323:42:043
1193899230,22cyclictest0-21swapper/323:21:043
1193899230,22cyclictest0-21swapper/321:40:133
1193899230,22cyclictest0-21swapper/319:46:543
1193899230,1cyclictest0-21swapper/322:03:433
1193899230,1cyclictest0-21swapper/300:00:433
1193899230,0cyclictest0-21swapper/323:48:423
11936992323,0cyclictest5582-21diskmemload00:27:162
11936992323,0cyclictest0-21swapper/223:09:062
11936992323,0cyclictest0-21swapper/223:04:142
11936992322,1cyclictest0-21swapper/222:10:272
11936992321,1cyclictest25113-21diskmemload21:55:452
11936992321,1cyclictest0-21swapper/223:16:142
11936992321,1cyclictest0-21swapper/221:35:042
11936992321,1cyclictest0-21swapper/200:34:092
11936992321,1cyclictest0-21swapper/200:03:212
1193699230,2cyclictest0-21swapper/222:46:562
1193699230,23cyclictest0-21swapper/222:05:132
1193699230,22cyclictest6457-21sh22:36:132
1193699230,22cyclictest30162-21ssh21:31:542
1193699230,22cyclictest0-21swapper/220:15:002
1193699230,22cyclictest0-21swapper/200:12:572
1193699230,1cyclictest5582-21diskmemload22:31:122
1193699230,1cyclictest0-21swapper/222:55:552
1193699230,0cyclictest5582-21diskmemload23:14:282
1193699230,0cyclictest0-21swapper/222:40:192
1193699230,0cyclictest0-21swapper/222:04:402
1193699230,0cyclictest0-21swapper/221:51:372
11931992323,0cyclictest5582-21diskmemload22:42:141
11931992323,0cyclictest16851-21ssh00:11:171
11931992323,0cyclictest0-21swapper/123:12:081
11931992323,0cyclictest0-21swapper/122:58:481
11931992323,0cyclictest0-21swapper/122:33:291
11931992323,0cyclictest0-21swapper/121:41:351
11931992322,0cyclictest23628-21apt-get20:41:521
11931992321,1cyclictest0-21swapper/123:25:291
1193199231,21cyclictest0-21swapper/122:26:501
1193199230,2cyclictest22312-21sh23:46:541
1193199230,23cyclictest0-21swapper/123:15:471
1193199230,23cyclictest0-21swapper/122:14:201
1193199230,23cyclictest0-21swapper/100:15:291
1193199230,22cyclictest6154-21ssh21:10:241
1193199230,22cyclictest32294-21ssh00:23:591
1193199230,22cyclictest24423-21sh23:20:311
1193199230,0cyclictest0-21swapper/123:00:241
1193199230,0cyclictest0-21swapper/122:06:431
1193199230,0cyclictest0-21swapper/121:47:241
1193199230,0cyclictest0-21swapper/121:38:391
11927992323,0cyclictest62550irq/127-eno121:40:120
11927992323,0cyclictest5582-21diskmemload22:22:120
11927992323,0cyclictest5582-21diskmemload22:14:450
11927992323,0cyclictest28982-21ssh00:21:520
11927992323,0cyclictest0-21swapper/022:56:190
11927992322,1cyclictest3615-21sh23:31:030
11927992321,1cyclictest0-21swapper/021:10:010
11927992320,2cyclictest13450-21ssh00:36:100
1192799231,1cyclictest0-21swapper/019:25:000
1192799230,23cyclictest8863-21ssh22:09:290
1192799230,23cyclictest5582-21diskmemload23:00:200
1192799230,23cyclictest5582-21diskmemload22:43:000
1192799230,23cyclictest5582-21diskmemload22:18:500
1192799230,23cyclictest0-21swapper/022:00:280
1192799230,23cyclictest0-21swapper/021:23:030
1192799230,22cyclictest9951-21ssh22:38:420
1192799230,22cyclictest7155-21ssh00:30:180
1192799230,22cyclictest25199-21ssh00:17:330
1192799230,22cyclictest14917-21apt-get19:15:020
1192799230,0cyclictest5582-21diskmemload23:45:520
1192799230,0cyclictest0-21swapper/023:37:240
1192799230,0cyclictest0-21swapper/021:25:060
11938992222,0cyclictest0-21swapper/322:15:403
11938992220,1cyclictest28518-21diskmemload22:55:113
1193899220,22cyclictest5582-21diskmemload21:36:583
1193899220,21cyclictest3953-21perf20:00:003
1193899220,21cyclictest0-21swapper/321:16:213
1193899220,21cyclictest0-21swapper/300:20:093
1193899220,1cyclictest32624-21ssh22:30:193
1193899220,1cyclictest11151-21perf20:15:003
1193899220,1cyclictest0-21swapper/323:30:033
1193899220,1cyclictest0-21swapper/323:11:583
1193899220,1cyclictest0-21swapper/321:26:283
1193899220,1cyclictest0-21swapper/300:15:043
1193899220,1cyclictest0-21swapper/300:10:023
11936992222,0cyclictest0-21swapper/222:15:402
11936992221,1cyclictest0-21swapper/223:20:262
11936992220,1cyclictest5582-21diskmemload21:45:132
11936992220,1cyclictest31205-21apt-get20:56:512
11936992220,1cyclictest23030-21apt-get00:16:532
1193699220,21cyclictest3916-21sendmail20:00:002
1193699220,21cyclictest1199-21apt-get21:01:522
1193699220,21cyclictest0-21swapper/223:41:122
1193699220,21cyclictest0-21swapper/222:51:242
1193699220,21cyclictest0-21swapper/222:25:212
1193699220,21cyclictest0-21swapper/221:25:122
1193699220,21cyclictest0-21swapper/219:46:542
1193699220,21cyclictest0-21swapper/219:41:492
1193699220,21cyclictest0-21swapper/200:20:282
1193699220,1cyclictest18365-21awk20:30:012
1193699220,0cyclictest0-21swapper/200:35:282
11931992222,0cyclictest5582-21diskmemload23:31:531
11931992222,0cyclictest0-21swapper/122:45:021
11931992222,0cyclictest0-21swapper/122:37:001
11931992221,1cyclictest23323-21sh21:25:461
1193199220,22cyclictest5582-21diskmemload00:06:141
1193199220,21cyclictest32332-21ssh23:56:111
1193199220,21cyclictest32332-21ssh23:56:111
1193199220,21cyclictest18345-21cron20:30:011
1193199220,21cyclictest0-21swapper/122:15:251
1193199220,21cyclictest0-21swapper/120:01:511
1193199220,1cyclictest29175-21ssh23:52:101
1193199220,1cyclictest19962-21ssh21:51:251
1193199220,1cyclictest0-21swapper/100:30:311
11927992222,0cyclictest5582-21diskmemload21:55:450
11927992222,0cyclictest0-21swapper/023:10:160
11927992222,0cyclictest0-21swapper/021:35:590
11927992222,0cyclictest0-21swapper/021:15:210
1192799222,0cyclictest62550irq/127-eno123:28:250
1192799220,22cyclictest0-21swapper/023:05:370
1192799220,22cyclictest0-21swapper/021:33:520
1192799220,21cyclictest28012-21apt20:50:000
1192799220,1cyclictest13283-21ssh21:45:040
1192799220,1cyclictest13113-21ssh00:07:000
1192799220,1cyclictest11538-21apt-get20:16:510
1192799220,0cyclictest5582-21diskmemload23:15:140
1192799220,0cyclictest0-21swapper/000:10:200
1192799220,0cyclictest0-21swapper/000:00:150
11938992119,2cyclictest21917-21basename19:30:013
1193899210,20cyclictest0-21swapper/319:41:503
11936992119,2cyclictest21902-21perf19:30:012
1193699210,20cyclictest0-21swapper/220:21:512
11931992121,0cyclictest0-21swapper/121:20:031
11931992119,1cyclictest31955-21apt-get19:51:511
11931992119,1cyclictest30422-21apt-get20:55:031
1193199210,21cyclictest31048-21rm22:00:381
1193199210,20cyclictest0-21swapper/119:36:521
1193199210,0cyclictest0-21swapper/121:16:171
1193199210,0cyclictest0-21swapper/120:31:511
1193199210,0cyclictest0-21swapper/119:26:521
11927992121,0cyclictest19907-21apt-get19:26:520
11927992121,0cyclictest0-21swapper/019:56:520
1192799210,21cyclictest0-21swapper/020:36:510
1192799210,0cyclictest0-21swapper/019:36:510
11938992020,0cyclictest0-21swapper/320:06:523
11938992019,1cyclictest0-21swapper/320:16:513
1193899200,0cyclictest0-21swapper/320:21:513
11936992020,0cyclictest0-21swapper/220:16:512
11936992020,0cyclictest0-21swapper/220:06:522
11936992019,1cyclictest14303-21apt-get19:15:022
1193699200,0cyclictest28411-21apt-get20:51:502
1193199200,20cyclictest0-21swapper/121:01:521
1193199200,0cyclictest0-21swapper/119:56:521
1193199200,0cyclictest0-21swapper/119:31:521
1193199200,0cyclictest0-21swapper/119:21:521
11927992020,0cyclictest4356-21apt-get20:01:520
11927992020,0cyclictest0-21swapper/020:51:500
11927992020,0cyclictest0-21swapper/020:41:520
11927992018,1cyclictest18359-21idleruntime-cro20:30:010
1192799200,0cyclictest0-21swapper/019:46:540
11938991919,0cyclictest0-21swapper/319:15:023
11938991918,0cyclictest0-21swapper/321:01:523
11938991918,0cyclictest0-21swapper/319:51:513
11936991918,0cyclictest0-21swapper/219:51:512
11936991917,1cyclictest23169-21perf20:40:002
11931991919,0cyclictest0-21swapper/120:21:511
11931991919,0cyclictest0-21swapper/120:16:501
11931991919,0cyclictest0-21swapper/120:11:571
11931991919,0cyclictest0-21swapper/120:06:521
11931991919,0cyclictest0-21swapper/119:15:021
11931991917,1cyclictest23138-21idleruntime-cro20:40:001
11927991919,0cyclictest0-21swapper/021:01:520
11927991919,0cyclictest0-21swapper/020:11:580
11927991917,1cyclictest8759-21idleruntime-cro20:10:000
11938991818,0cyclictest0-21swapper/320:26:513
11938991817,0cyclictest0-21swapper/319:21:523
1193899180,0cyclictest0-21swapper/320:31:513
11936991817,0cyclictest17513-21apt-get19:21:522
11936991816,1cyclictest24751-21apt-get19:36:522
11927991818,0cyclictest0-21swapper/019:41:490
11927991817,1cyclictest1547-21munin-run19:55:000
11938991716,0cyclictest0-21swapper/319:36:523
11936991716,1cyclictest0-21swapper/220:46:522
1193699170,0cyclictest0-21swapper/220:31:512
11927991717,0cyclictest0-21swapper/020:31:510
1192799170,0cyclictest0-21swapper/020:55:030
11938991616,0cyclictest0-21swapper/320:46:523
11936991615,0cyclictest0-21swapper/220:01:512
1193199163,12cyclictest14193-21munin-node21:08:131
1192799160,1cyclictest14363-21munin-run19:15:000
11938991514,0cyclictest0-21swapper/320:41:523
11936991513,1cyclictest0-21swapper/219:31:582
1193699151,13cyclictest793-21lldpd20:44:402
1193699150,1cyclictest0-21swapper/219:11:542
11927991514,1cyclictest13966-21apt-get20:21:510
11938991414,0cyclictest0-21swapper/320:01:513
1193899140,14cyclictest0-21swapper/319:10:113
1193899140,0cyclictest0-21swapper/321:07:463
1193699140,0cyclictest0-21swapper/221:07:462
1193199140,14cyclictest0-21swapper/120:50:301
1193199140,14cyclictest0-21swapper/119:43:251
1193199140,14cyclictest0-21swapper/119:10:101
1192799140,14cyclictest0-21swapper/021:05:200
11938991313,0cyclictest0-21swapper/320:52:003
11938991313,0cyclictest0-21swapper/319:31:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional