You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 07:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 22, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2646899260,25cyclictest606-21dbus-daemon00:05:003
2646799260,2cyclictest20526-21diskmemload22:17:222
2646899250,1cyclictest16570-21sh22:32:493
2646799250,24cyclictest27104-21ssh22:41:552
2646699253,21cyclictest10953-21awk20:50:011
26466992523,1cyclictest0-21swapper/122:00:531
2646699250,24cyclictest23713-21ssh23:07:461
2646699250,24cyclictest20526-21diskmemload00:10:221
2646699250,24cyclictest0-21swapper/120:17:481
26465992523,1cyclictest13318-21cron20:55:000
2646599250,24cyclictest0-21swapper/021:50:060
2646599250,0cyclictest0-21swapper/022:08:220
2646599250,0cyclictest0-21swapper/022:08:220
26468992421,2cyclictest27629-21ssh23:10:293
26468992421,2cyclictest20526-21diskmemload23:07:563
2646899240,24cyclictest0-21swapper/300:20:423
2646899240,23cyclictest20260-21basename00:30:013
2646899240,23cyclictest0-21swapper/323:48:103
2646899240,23cyclictest0-21swapper/322:57:483
2646899240,23cyclictest0-21swapper/322:15:253
2646899240,1cyclictest4702-21ssh00:16:423
2646899240,1cyclictest0-21swapper/321:23:413
2646899240,1cyclictest0-21swapper/321:23:413
2646899240,0cyclictest0-21swapper/321:36:093
26467992424,0cyclictest0-21swapper/222:53:202
26467992423,1cyclictest20526-21diskmemload00:10:392
2646799240,24cyclictest24293-21ssh00:04:422
2646799240,23cyclictest20526-21diskmemload22:38:542
2646799240,23cyclictest20526-21diskmemload21:36:402
2646799240,23cyclictest0-21swapper/223:11:372
2646799240,1cyclictest29276-21ssh00:08:512
2646799240,1cyclictest20526-21diskmemload23:58:072
26466992424,0cyclictest0-21swapper/123:04:101
26466992422,1cyclictest22225-21sh00:32:311
2646699240,23cyclictest20526-21diskmemload00:23:081
2646699240,23cyclictest20526-21diskmemload00:01:291
2646699240,23cyclictest18965-21kworker/u8:121:22:221
2646699240,23cyclictest18965-21kworker/u8:121:22:221
2646699240,23cyclictest15036-21rm22:30:451
2646699240,0cyclictest0-21swapper/122:51:061
2646699240,0cyclictest0-21swapper/121:39:101
26465992423,1cyclictest62550irq/127-eno123:29:020
2646599240,24cyclictest20526-21diskmemload21:31:400
2646599240,24cyclictest0-21swapper/022:39:000
2646599240,24cyclictest0-21swapper/022:20:280
2646599240,23cyclictest0-21swapper/021:55:480
2646599240,23cyclictest0-21swapper/021:38:380
2646599240,1cyclictest10266-21sh21:29:180
2646599240,0cyclictest0-21swapper/023:56:290
2646599240,0cyclictest0-21swapper/000:32:270
26468992323,0cyclictest20526-21diskmemload23:32:543
26468992323,0cyclictest0-21swapper/323:59:023
26468992323,0cyclictest0-21swapper/323:39:353
26468992321,1cyclictest0-21swapper/322:38:083
2646899231,21cyclictest4613-21sh22:21:453
2646899230,23cyclictest20526-21diskmemload23:42:503
2646899230,23cyclictest20526-21diskmemload21:54:153
2646899230,23cyclictest0-21swapper/322:29:263
2646899230,23cyclictest0-21swapper/321:17:453
2646899230,22cyclictest6628-21apt-get20:42:493
2646899230,22cyclictest3716-21ssh22:49:153
2646899230,22cyclictest28921-21ssh00:08:143
2646899230,22cyclictest12716-21sh23:26:303
2646899230,22cyclictest0-21swapper/323:25:003
2646899230,22cyclictest0-21swapper/323:15:073
2646899230,0cyclictest20526-21diskmemload21:13:103
2646899230,0cyclictest0-21swapper/323:51:573
2646899230,0cyclictest0-21swapper/322:05:083
2646899230,0cyclictest0-21swapper/322:05:083
26467992323,0cyclictest0-21swapper/223:52:132
26467992323,0cyclictest0-21swapper/223:33:492
26467992323,0cyclictest0-21swapper/223:27:232
26467992323,0cyclictest0-21swapper/221:25:062
26467992322,1cyclictest30713-21ssh23:42:262
26467992322,1cyclictest20526-21diskmemload21:46:592
26467992321,1cyclictest15607-21sh22:59:432
26467992321,1cyclictest0-21swapper/221:32:482
2646799230,2cyclictest27604-21sh00:37:102
2646799230,23cyclictest0-21swapper/222:27:392
2646799230,23cyclictest0-21swapper/200:26:222
2646799230,22cyclictest14861-21ssh22:30:322
2646799230,1cyclictest20526-21diskmemload21:12:082
2646799230,0cyclictest0-21swapper/223:22:042
2646799230,0cyclictest0-21swapper/223:17:592
2646799230,0cyclictest0-21swapper/222:03:462
2646799230,0cyclictest0-21swapper/200:34:072
26466992323,0cyclictest0-21swapper/122:47:261
26466992323,0cyclictest0-21swapper/121:15:201
26466992323,0cyclictest0-21swapper/121:10:091
26466992321,2cyclictest2160-21ssh21:50:251
26466992321,1cyclictest18347-21apt-get22:05:021
26466992321,1cyclictest18347-21apt-get22:05:021
26466992321,1cyclictest0-21swapper/123:57:491
26466992321,1cyclictest0-21swapper/123:31:211
26466992321,1cyclictest0-21swapper/122:59:081
26466992321,1cyclictest0-21swapper/122:42:411
26466992321,1cyclictest0-21swapper/122:26:571
26466992321,1cyclictest0-21swapper/121:42:261
26466992321,1cyclictest0-21swapper/119:35:001
26466992320,2cyclictest313-21systemd-journal19:40:001
2646699230,23cyclictest0-21swapper/123:20:471
2646699230,23cyclictest0-21swapper/100:17:201
2646699230,22cyclictest31266-21rm22:16:411
2646699230,22cyclictest28682-21sh21:45:071
2646699230,22cyclictest20526-21diskmemload22:20:551
2646699230,22cyclictest19435-21ssh00:28:541
2646699230,22cyclictest1667-21sh23:44:321
2646699230,22cyclictest0-21swapper/121:56:041
2646699230,1cyclictest0-21swapper/122:10:511
2646699230,0cyclictest0-21swapper/123:17:161
2646699230,0cyclictest0-21swapper/121:29:391
2646699230,0cyclictest0-21swapper/100:09:481
26465992323,0cyclictest20526-21diskmemload23:02:360
26465992322,1cyclictest20526-21diskmemload00:29:440
26465992322,1cyclictest0-21swapper/023:06:380
26465992321,1cyclictest31774-21apt-get20:27:480
26465992321,1cyclictest12366-21ssh22:57:440
26465992321,1cyclictest0-21swapper/023:31:230
26465992321,1cyclictest0-21swapper/023:10:590
26465992321,1cyclictest0-21swapper/021:24:580
26465992321,1cyclictest0-21swapper/021:24:580
26465992320,2cyclictest7918-21sh23:50:110
26465992320,2cyclictest27057-21sh21:43:430
2646599231,21cyclictest62550irq/127-eno100:06:160
2646599230,23cyclictest20526-21diskmemload23:42:580
2646599230,23cyclictest0-21swapper/023:20:430
2646599230,23cyclictest0-21swapper/022:00:180
2646599230,22cyclictest8981-21apt-get19:42:460
2646599230,22cyclictest29408-21ssh22:14:210
2646599230,22cyclictest2605-21ssh23:45:320
2646599230,22cyclictest10235-21cron22:55:010
2646599230,22cyclictest0-21swapper/022:32:550
2646599230,22cyclictest0-21swapper/022:26:460
2646599230,22cyclictest0-21swapper/000:02:220
2646599230,1cyclictest23701-21perf20:10:000
2646599230,1cyclictest0-21swapper/022:16:470
2646599230,0cyclictest20526-21diskmemload23:38:510
2646599230,0cyclictest20526-21diskmemload00:23:290
2646599230,0cyclictest0-21swapper/021:45:060
2646599230,0cyclictest0-21swapper/021:10:280
2646599230,0cyclictest0-21swapper/000:15:520
26468992222,0cyclictest20526-21diskmemload22:50:403
26468992220,1cyclictest0-21swapper/300:35:163
2646899220,21cyclictest31732-21apt-get19:22:453
2646899220,21cyclictest27109-21sh22:41:563
2646899220,21cyclictest26917-21apt-get19:12:463
2646899220,21cyclictest20526-21diskmemload22:01:403
2646899220,21cyclictest20526-21diskmemload00:30:563
2646899220,21cyclictest0-21swapper/321:40:093
2646899220,1cyclictest31800-21ssh00:12:003
2646899220,1cyclictest28882-21ssh21:45:213
2646899220,1cyclictest0-21swapper/323:01:013
2646899220,1cyclictest0-21swapper/321:56:033
2646899220,1cyclictest0-21swapper/321:30:033
26467992222,0cyclictest0-21swapper/223:45:582
26467992222,0cyclictest0-21swapper/222:20:062
26467992220,2cyclictest19140-21ssh22:05:132
26467992220,2cyclictest19140-21ssh22:05:132
26467992220,1cyclictest3703-21cat19:30:002
26467992220,1cyclictest10946-21idleruntime-cro20:50:012
26467992220,1cyclictest0-21swapper/200:15:472
2646799220,21cyclictest4205-21apt-get20:37:452
2646799220,21cyclictest24749-21rm22:10:132
2646799220,21cyclictest23018-21sh21:40:332
2646799220,21cyclictest22002-21ssh23:05:332
2646799220,21cyclictest20526-21diskmemload21:20:172
2646799220,21cyclictest20526-21diskmemload21:20:172
2646799220,21cyclictest0-21swapper/221:15:032
2646799220,1cyclictest31383-21rm22:45:042
2646799220,1cyclictest31320-21perf20:25:002
2646799220,1cyclictest11978-21ssh21:58:582
2646799220,1cyclictest0-21swapper/223:36:072
2646799220,1cyclictest0-21swapper/221:52:292
26466992220,1cyclictest2213-21ssh23:45:031
2646699220,21cyclictest21763-21apt-get20:07:461
2646699220,21cyclictest0-21swapper/123:35:231
2646699220,21cyclictest0-21swapper/122:35:021
2646699220,21cyclictest0-21swapper/121:33:371
2646699220,1cyclictest20526-21diskmemload23:50:421
26465992222,0cyclictest0-21swapper/020:22:470
26465992221,1cyclictest62550irq/127-eno100:10:120
26465992219,2cyclictest26314-21ssh00:35:130
2646599220,22cyclictest20526-21diskmemload21:17:310
2646599220,21cyclictest20526-21diskmemload22:45:140
2646599220,21cyclictest11527-21apt-get19:45:020
2646599220,0cyclictest0-21swapper/022:40:520
26468992121,0cyclictest19369-21apt-get20:02:463
26468992121,0cyclictest10909-21apt-get19:45:023
26468992121,0cyclictest0-21swapper/322:11:193
26468992118,2cyclictest20518-21cron21:10:003
2646899210,20cyclictest14161-21apt-get19:52:443
2646899210,20cyclictest0-21swapper/320:57:483
26467992119,1cyclictest16092-21turbostat.cron19:55:012
2646799210,21cyclictest0-21swapper/223:03:322
2646799210,20cyclictest0-21swapper/220:17:472
2646799210,1cyclictest0-21swapper/220:30:012
26466992121,0cyclictest20526-21diskmemload00:35:021
26466992120,1cyclictest1766-21apt-get19:27:471
2646699210,21cyclictest0-21swapper/121:07:491
2646699210,21cyclictest0-21swapper/119:42:461
2646699210,1cyclictest0-21swapper/120:10:021
2646699210,0cyclictest0-21swapper/119:22:451
26465992119,1cyclictest16096-21latency_hist19:55:010
2646599210,20cyclictest18621-21apt-get21:07:490
2646599210,20cyclictest0-21swapper/019:22:450
26468992020,0cyclictest26961-21apt-get20:17:483
26468992020,0cyclictest24553-21apt-get20:12:473
26468992020,0cyclictest0-21swapper/319:57:473
26468992019,0cyclictest0-21swapper/319:17:483
2646899200,0cyclictest0-21swapper/320:47:473
26467992020,0cyclictest0-21swapper/221:07:492
26467992020,0cyclictest0-21swapper/220:42:492
26467992020,0cyclictest0-21swapper/220:07:462
26466992017,2cyclictest6134-21latency_hist20:40:011
2646699200,0cyclictest0-21swapper/120:22:461
26467991918,0cyclictest0-21swapper/219:12:462
26466991917,1cyclictest10909-21apt-get19:45:021
26466991917,1cyclictest0-21swapper/121:05:001
2646699190,0cyclictest0-21swapper/119:57:471
2646599194,14cyclictest16194-21/usr/sbin/munin21:02:520
26465991919,0cyclictest0-21swapper/020:17:480
26465991919,0cyclictest0-21swapper/019:12:460
26468991818,0cyclictest0-21swapper/320:27:483
26467991818,0cyclictest16955-21apt-get19:57:472
26467991818,0cyclictest0-21swapper/219:37:462
26466991818,0cyclictest0-21swapper/120:32:461
26466991818,0cyclictest0-21swapper/120:32:461
26465991818,0cyclictest0-21swapper/020:37:440
26465991818,0cyclictest0-21swapper/019:57:470
26465991817,1cyclictest10958-21latency_hist20:50:010
26468991715,1cyclictest10909-21apt-get19:45:013
26467991717,0cyclictest0-21swapper/220:52:472
26467991717,0cyclictest0-21swapper/220:10:022
26465991717,0cyclictest0-21swapper/019:37:460
26465991717,0cyclictest0-21swapper/019:27:470
26465991714,2cyclictest6074-21cron19:35:000
26468991616,0cyclictest0-21swapper/320:22:463
2646899160,1cyclictest313-21systemd-journal19:28:503
26467991616,0cyclictest4167-21apt-get19:32:462
26467991615,0cyclictest0-21swapper/219:45:022
26466991616,0cyclictest0-21swapper/120:27:481
2646699160,15cyclictest14280-21cpuspeed_turbos19:52:451
26465991616,0cyclictest0-21swapper/020:10:020
2646899150,1cyclictest2617-21/usr/sbin/munin20:32:503
2646899150,1cyclictest2617-21/usr/sbin/munin20:32:503
2646799152,6cyclictest1274-21idleruntime-cro19:25:002
26466991515,0cyclictest0-21swapper/120:42:491
26466991515,0cyclictest0-21swapper/120:02:461
26468991414,0cyclictest0-21swapper/320:05:243
26468991414,0cyclictest0-21swapper/319:35:173
2646899140,14cyclictest0-21swapper/320:53:183
2646899140,0cyclictest0-21swapper/321:02:503
2646899140,0cyclictest0-21swapper/320:35:023
2646899140,0cyclictest0-21swapper/319:31:573
2646799140,14cyclictest0-21swapper/221:00:172
2646799140,14cyclictest0-21swapper/220:01:212
2646799140,14cyclictest0-21swapper/219:40:492
2646799140,14cyclictest0-21swapper/219:16:312
2646799140,0cyclictest0-21swapper/220:55:382
2646799140,0cyclictest0-21swapper/220:32:282
2646799140,0cyclictest0-21swapper/220:32:282
2646699140,0cyclictest0-21swapper/119:15:071
26465991414,0cyclictest0-21swapper/020:55:110
26465991414,0cyclictest0-21swapper/020:40:060
26465991414,0cyclictest0-21swapper/020:30:310
26465991414,0cyclictest0-21swapper/020:30:310
2646599140,0cyclictest0-21swapper/020:00:450
2646599140,0cyclictest0-21swapper/019:15:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional