You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 09:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu May 14, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4723992621,4cyclictest0-21swapper/200:31:442
472399260,25cyclictest8563-21ssh21:19:032
471899260,2cyclictest10398-21sh21:21:141
4727992525,0cyclictest0-21swapper/323:07:563
472799250,24cyclictest30389-21diskmemload23:43:453
472799250,24cyclictest30389-21diskmemload00:14:223
472799250,24cyclictest0-21swapper/323:22:013
472799250,24cyclictest0-21swapper/323:03:593
472799250,1cyclictest25953-21runrttasks21:34:423
4723992525,0cyclictest0-21swapper/223:28:402
472399250,24cyclictest28005-21cron21:05:012
472399250,24cyclictest0-21swapper/223:40:322
472399250,24cyclictest0-21swapper/222:04:232
471899250,24cyclictest30389-21diskmemload23:59:481
471899250,24cyclictest30389-21diskmemload00:18:451
471899250,24cyclictest30389-21diskmemload00:10:541
471899250,24cyclictest0-21swapper/123:12:461
471899250,24cyclictest0-21swapper/123:04:011
471899250,24cyclictest0-21swapper/100:06:201
4716992523,1cyclictest0-21swapper/022:29:470
471699250,24cyclictest0-21swapper/021:41:180
471699250,24cyclictest0-21swapper/000:14:080
4727992423,1cyclictest6551-21ssh22:15:053
4727992423,1cyclictest0-21swapper/322:02:363
472799240,24cyclictest30389-21diskmemload23:47:383
472799240,23cyclictest23427-21rm22:57:593
472799240,23cyclictest0-21swapper/322:39:593
4723992422,1cyclictest30389-21diskmemload23:53:192
4723992421,2cyclictest13562-21awk20:35:012
4723992420,3cyclictest22185-21sed00:22:142
4723992420,0cyclictest0-21swapper/222:51:402
472399240,24cyclictest0-21swapper/200:09:322
472399240,23cyclictest31090-21ssh23:33:512
472399240,23cyclictest30389-21diskmemload23:36:162
472399240,23cyclictest30389-21diskmemload22:20:312
472399240,0cyclictest30389-21diskmemload23:06:072
472399240,0cyclictest30389-21diskmemload22:38:202
4718992421,2cyclictest21731-21ssh23:26:061
471899240,24cyclictest0-21swapper/123:38:401
471899240,23cyclictest30389-21diskmemload21:47:051
471899240,23cyclictest28644-21sh22:06:171
471899240,23cyclictest0-21swapper/121:55:451
4716992424,0cyclictest0-21swapper/022:07:030
4716992422,1cyclictest0-21swapper/000:35:360
471699240,24cyclictest0-21swapper/021:32:200
471699240,23cyclictest7177-21ssh22:15:520
471699240,23cyclictest21586-21gltestperf22:57:070
471699240,23cyclictest16460-21sh21:55:050
471699240,23cyclictest0-21swapper/023:11:040
471699240,23cyclictest0-21swapper/022:01:510
471699240,23cyclictest0-21swapper/021:50:470
471699240,20cyclictest0-21swapper/000:22:050
471699240,1cyclictest17938-21diskmemload00:18:560
4727992323,0cyclictest30389-21diskmemload23:27:243
4727992323,0cyclictest30389-21diskmemload21:25:293
4727992323,0cyclictest0-21swapper/323:57:323
4727992322,1cyclictest30389-21diskmemload00:36:193
4727992321,1cyclictest0-21swapper/300:01:093
4727992320,2cyclictest9386-21idleruntime-cro21:20:013
472799231,21cyclictest30389-21diskmemload22:25:013
472799231,21cyclictest14860-21apt-get00:17:043
472799230,23cyclictest0-21swapper/323:31:363
472799230,23cyclictest0-21swapper/322:27:583
472799230,23cyclictest0-21swapper/321:21:573
472799230,23cyclictest0-21swapper/300:32:083
472799230,22cyclictest5920-21sh22:14:373
472799230,22cyclictest14073-21ssh22:50:163
472799230,1cyclictest17111-21apt-get19:37:043
472799230,1cyclictest14318-21awk19:30:013
472799230,0cyclictest0-21swapper/323:54:073
472799230,0cyclictest0-21swapper/321:58:183
472799230,0cyclictest0-21swapper/321:50:513
472799230,0cyclictest0-21swapper/321:41:453
472799230,0cyclictest0-21swapper/300:25:333
4723992323,0cyclictest30389-21diskmemload23:45:102
4723992323,0cyclictest0-21swapper/222:57:242
4723992322,1cyclictest30389-21diskmemload23:56:522
4723992321,1cyclictest26539-21ssh23:01:462
4723992321,1cyclictest0-21swapper/200:17:102
4723992321,0cyclictest0-21swapper/200:29:032
4723992320,0cyclictest0-21swapper/221:39:472
472399230,2cyclictest9752-21sh23:15:042
472399230,23cyclictest0-21swapper/221:34:252
472399230,23cyclictest0-21swapper/221:28:262
472399230,22cyclictest5545-21ssh21:45:232
472399230,22cyclictest5058-21ssh23:11:252
472399230,22cyclictest30389-21diskmemload21:57:032
472399230,22cyclictest23294-21ssh22:29:442
472399230,22cyclictest0-21swapper/223:24:412
472399230,22cyclictest0-21swapper/222:13:282
472399230,1cyclictest3032-21sh21:14:082
472399230,0cyclictest0-21swapper/221:24:302
4718992323,0cyclictest0-21swapper/122:57:391
4718992323,0cyclictest0-21swapper/100:22:421
4718992322,1cyclictest30389-21diskmemload00:25:051
4718992321,1cyclictest0-21swapper/122:00:291
4718992320,2cyclictest5262-21sh22:13:351
4718992320,2cyclictest24038-21sh22:30:171
471899230,2cyclictest29250-21sh00:01:061
471899230,23cyclictest0-21swapper/123:47:161
471899230,23cyclictest0-21swapper/122:19:111
471899230,22cyclictest3666-21sh00:35:121
471899230,22cyclictest30389-21diskmemload22:45:391
471899230,22cyclictest16020-21ssh23:20:561
471899230,22cyclictest0-21swapper/122:35:061
471899230,22cyclictest0-21swapper/121:28:201
471899230,22cyclictest0-21swapper/100:32:141
471899230,1cyclictest2692-21ssh21:13:421
471899230,0cyclictest0-21swapper/123:34:481
471899230,0cyclictest0-21swapper/122:22:441
4716992323,0cyclictest30389-21diskmemload23:43:450
4716992323,0cyclictest30389-21diskmemload23:01:540
4716992322,1cyclictest30389-21diskmemload21:28:030
4716992321,1cyclictest21036-21sh23:25:130
4716992321,1cyclictest0-21swapper/023:55:100
4716992321,1cyclictest0-21swapper/023:17:070
4716992321,1cyclictest0-21swapper/000:10:010
4716992320,2cyclictest19121-21grep19:40:010
471699231,21cyclictest30389-21diskmemload22:46:040
471699230,2cyclictest17609-21ssh22:52:400
471699230,23cyclictest0-21swapper/023:38:310
471699230,23cyclictest0-21swapper/022:10:190
471699230,23cyclictest0-21swapper/021:15:390
471699230,22cyclictest31038-21sh21:10:310
471699230,22cyclictest30476-21ssh00:30:130
471699230,22cyclictest16668-21munin-run23:50:000
471699230,22cyclictest10188-21ssh21:20:570
471699230,22cyclictest0-21swapper/000:27:360
471699230,1cyclictest26851-21sh23:30:250
471699230,1cyclictest0-21swapper/022:22:050
471699230,0cyclictest62550irq/127-eno122:37:350
4727992222,0cyclictest30389-21diskmemload00:23:193
4727992222,0cyclictest0-21swapper/322:47:063
4727992222,0cyclictest0-21swapper/322:31:323
4727992222,0cyclictest0-21swapper/321:10:023
4727992220,1cyclictest2862-21sh22:40:183
4727992220,1cyclictest2076-21apt-get00:05:023
4727992220,1cyclictest19529-21apt-get19:42:053
4727992220,1cyclictest11177-21ssh23:17:043
472799220,22cyclictest0-21swapper/322:05:513
472799220,22cyclictest0-21swapper/321:45:583
472799220,21cyclictest4280-21ssh23:10:163
472799220,21cyclictest0-21swapper/323:35:043
472799220,21cyclictest0-21swapper/321:35:213
472799220,21cyclictest0-21swapper/319:12:033
472799220,1cyclictest21168-21apt-get20:52:033
4723992222,0cyclictest0-21swapper/222:46:492
4723992222,0cyclictest0-21swapper/221:50:082
4723992220,2cyclictest13963-21apt-get20:37:042
4723992220,1cyclictest6773-21apt-get20:22:032
4723992220,1cyclictest29182-21apt-get20:02:032
4723992220,1cyclictest0-21swapper/219:40:012
4723992219,3cyclictest0-21swapper/222:30:182
4723992218,2cyclictest29172-21sh00:00:522
472399220,21cyclictest28602-21ssh22:06:142
472399220,1cyclictest3876-21ssh00:35:272
472399220,1cyclictest3516-21ssh22:41:172
472399220,1cyclictest1071-21rm21:41:572
472399220,1cyclictest0-21swapper/222:17:032
472399220,0cyclictest0-21swapper/200:12:282
4718992222,0cyclictest0-21swapper/123:05:251
4718992222,0cyclictest0-21swapper/121:36:411
4718992221,1cyclictest0-21swapper/123:50:051
4718992221,1cyclictest0-21swapper/121:31:551
4718992220,1cyclictest25634-21awk21:00:011
4718992220,1cyclictest0-21swapper/122:40:231
4718992220,1cyclictest0-21swapper/121:42:321
4718992220,1cyclictest0-21swapper/121:15:151
471899220,21cyclictest0-21swapper/121:51:471
471899220,21cyclictest0-21swapper/120:42:051
471899220,21cyclictest0-21swapper/119:27:031
471899220,1cyclictest9908-21sh23:43:401
471899220,1cyclictest0-21swapper/122:28:481
471899220,0cyclictest0-21swapper/122:50:261
4716992222,0cyclictest0-21swapper/023:05:380
4716992222,0cyclictest0-21swapper/022:40:070
4716992220,1cyclictest0-21swapper/021:37:460
4716992220,1cyclictest0-21swapper/000:01:040
471699220,22cyclictest30389-21diskmemload23:24:030
471699220,22cyclictest0-21swapper/022:30:040
471699220,1cyclictest16709-21sh23:50:010
471699220,1cyclictest0-21swapper/021:46:540
4727992120,1cyclictest7506-21apt-get19:17:033
4727992120,0cyclictest0-21swapper/320:57:043
4727992119,1cyclictest30408-21ls21:10:013
4727992119,1cyclictest0-21swapper/320:25:013
472799210,0cyclictest0-21swapper/319:22:043
4723992121,0cyclictest0-21swapper/219:47:022
472399210,1cyclictest25610-21turbostat.cron21:00:002
472399210,0cyclictest0-21swapper/220:42:052
472399210,0cyclictest0-21swapper/220:17:032
4718992121,0cyclictest0-21swapper/120:02:031
4718992120,0cyclictest31574-21apt-get20:07:031
4718992120,0cyclictest0-21swapper/119:42:041
471899210,0cyclictest23161-21perf20:55:001
4716992121,0cyclictest0-21swapper/019:47:020
4716992119,1cyclictest606-21dbus-daemon20:30:010
4716992119,1cyclictest13531-21idleruntime-cro20:35:010
471699210,20cyclictest0-21swapper/020:52:030
471699210,0cyclictest14297-21perf19:30:010
472799200,19cyclictest28780-21awk20:00:003
4723992020,0cyclictest12319-21apt-get19:27:032
472399200,20cyclictest0-21swapper/221:07:052
472399200,0cyclictest24369-21apt-get19:52:042
472399200,0cyclictest0-21swapper/219:32:032
4718992020,0cyclictest1550-21apt-get20:12:051
4718992020,0cyclictest0-21swapper/120:20:021
4718992020,0cyclictest0-21swapper/120:17:031
4718992020,0cyclictest0-21swapper/119:32:041
4718992018,1cyclictest15960-21perf20:40:001
4716992019,1cyclictest16382-21apt-get20:42:050
471699200,20cyclictest0-21swapper/020:50:000
471699200,0cyclictest0-21swapper/019:57:040
4727991919,0cyclictest0-21swapper/320:02:033
4727991918,0cyclictest0-21swapper/320:42:053
4723991918,1cyclictest9922-21apt-get19:22:032
4723991918,1cyclictest0-21swapper/219:57:042
4718991919,0cyclictest0-21swapper/120:47:031
4718991918,1cyclictest26032-21apt-get21:02:031
4718991916,2cyclictest26344-21cron19:55:001
4716991919,0cyclictest0-21swapper/020:07:030
4716991918,0cyclictest3951-21apt-get20:17:030
471699190,18cyclictest0-21swapper/019:32:040
4727991818,0cyclictest0-21swapper/319:47:023
4723991818,0cyclictest0-21swapper/219:42:052
4723991817,1cyclictest0-21swapper/219:17:032
4718991818,0cyclictest0-21swapper/119:47:021
4718991817,1cyclictest0-21swapper/120:32:041
4718991817,0cyclictest26767-21apt-get19:57:041
4716991818,0cyclictest0-21swapper/020:57:040
4716991818,0cyclictest0-21swapper/020:22:030
4716991818,0cyclictest0-21swapper/019:52:030
4716991818,0cyclictest0-21swapper/019:17:030
4727991717,0cyclictest0-21swapper/320:37:043
4727991717,0cyclictest0-21swapper/320:27:023
4727991717,0cyclictest0-21swapper/320:12:063
4723991714,2cyclictest313-21systemd-journal20:55:002
4718991717,0cyclictest0-21swapper/121:07:051
4718991717,0cyclictest0-21swapper/119:22:031
4718991717,0cyclictest0-21swapper/119:17:031
4716991717,0cyclictest0-21swapper/019:22:040
4716991715,1cyclictest611-21irqbalance20:39:000
4727991616,0cyclictest0-21swapper/320:47:033
4727991616,0cyclictest0-21swapper/320:07:033
4723991616,0cyclictest0-21swapper/220:12:052
471899164,12cyclictest14536-21munin-node19:35:501
4718991616,0cyclictest9166-21apt-get20:27:021
4716991616,0cyclictest0-21swapper/019:12:030
4716991614,1cyclictest21503-21latency_hist19:45:010
4727991512,3cyclictest0-21swapper/319:34:573
4723991512,2cyclictest984-21runrttasks20:08:322
472799140,14cyclictest0-21swapper/321:00:393
472799140,0cyclictest0-21swapper/320:30:013
472799140,0cyclictest0-21swapper/320:15:523
472399141,9cyclictest1-21systemd20:47:112
472399140,0cyclictest0-21swapper/220:25:392
472399140,0cyclictest0-21swapper/219:10:382
4716991414,0cyclictest0-21swapper/021:05:340
471699140,14cyclictest0-21swapper/021:00:180
471699140,14cyclictest0-21swapper/020:10:100
471699140,0cyclictest0-21swapper/020:01:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional