You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 04:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Jul 23, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1185899260,25cyclictest17355-21dump-pmu-power22:50:010
1185899260,25cyclictest0-21swapper/021:37:520
11866992523,1cyclictest0-21swapper/323:55:473
1186699250,24cyclictest0-21swapper/300:17:533
1186699250,1cyclictest25096-21apt-get21:27:523
11862992521,3cyclictest0-21swapper/222:55:582
11860992523,1cyclictest0-21swapper/122:55:561
1186099250,24cyclictest5884-21diskmemload23:26:341
11858992521,3cyclictest5884-21diskmemload22:59:140
11858992521,3cyclictest0-21swapper/000:39:420
11858992520,4cyclictest0-21swapper/023:08:350
1185899250,24cyclictest27306-21ssh21:28:290
1185899250,24cyclictest0-21swapper/022:31:420
1185899250,24cyclictest0-21swapper/021:42:260
1185899250,24cyclictest0-21swapper/021:32:520
1185899250,24cyclictest0-21swapper/000:13:180
1185899250,21cyclictest20027-21kworker/u8:123:21:240
1185899250,0cyclictest0-21swapper/022:53:080
11866992421,2cyclictest30418-21perf23:30:013
1186699240,23cyclictest5884-21diskmemload23:31:453
11862992423,1cyclictest0-21swapper/221:11:062
11862992422,1cyclictest0-21swapper/223:27:562
11862992421,2cyclictest30196-21/usr/sbin/munin23:58:022
1186299240,24cyclictest0-21swapper/222:52:362
1186299240,23cyclictest9678-21ssh23:11:542
1186299240,23cyclictest5884-21diskmemload21:28:432
1186299240,23cyclictest23916-21latency_hist21:55:012
1186299240,1cyclictest7952-21taskset23:38:202
1186299240,0cyclictest0-21swapper/221:31:112
11860992424,0cyclictest0-21swapper/123:43:021
11860992423,1cyclictest0-21swapper/123:07:091
11860992422,1cyclictest1154-21/usr/sbin/munin00:32:541
1186099240,24cyclictest0-21swapper/123:53:541
1186099240,24cyclictest0-21swapper/122:11:301
1186099240,23cyclictest27911-21ssh23:57:201
1186099240,23cyclictest0-21swapper/121:23:381
1186099240,0cyclictest0-21swapper/122:46:331
11858992424,0cyclictest0-21swapper/021:20:040
11858992422,2cyclictest0-21swapper/023:19:300
11858992421,3cyclictest0-21swapper/022:09:050
11858992421,2cyclictest5884-21diskmemload21:10:010
11858992418,5cyclictest8659-21perf20:10:000
1185899240,23cyclictest5884-21diskmemload00:03:550
1185899240,23cyclictest13484-21grep20:20:010
1185899240,23cyclictest0-21swapper/023:41:570
1185899240,23cyclictest0-21swapper/021:56:040
1185899240,23cyclictest0-21swapper/000:16:150
1185899240,1cyclictest62550irq/127-eno100:31:350
1185899240,0cyclictest0-21swapper/023:00:130
1185899240,0cyclictest0-21swapper/022:41:180
11866992323,0cyclictest0-21swapper/323:43:063
11866992323,0cyclictest0-21swapper/323:16:543
11866992323,0cyclictest0-21swapper/322:39:573
11866992323,0cyclictest0-21swapper/322:17:153
11866992323,0cyclictest0-21swapper/321:17:043
11866992322,1cyclictest0-21swapper/300:11:173
11866992320,2cyclictest8336-21ssh21:41:173
11866992320,2cyclictest7279-21rm23:38:003
11866992320,2cyclictest15576-21cat22:48:013
1186699230,23cyclictest0-21swapper/323:22:433
1186699230,23cyclictest0-21swapper/323:03:553
1186699230,23cyclictest0-21swapper/322:10:383
1186699230,22cyclictest27653-21ssh22:58:093
1186699230,22cyclictest21848-21latency_hist19:30:013
1186699230,22cyclictest21848-21latency_hist19:30:013
1186699230,1cyclictest0-21swapper/322:03:313
1186699230,1cyclictest0-21swapper/300:07:213
1186699230,0cyclictest0-21swapper/323:10:583
1186699230,0cyclictest0-21swapper/321:53:083
1186699230,0cyclictest0-21swapper/321:31:123
11862992323,0cyclictest0-21swapper/222:38:442
11862992323,0cyclictest0-21swapper/222:05:222
11862992323,0cyclictest0-21swapper/222:01:032
11862992323,0cyclictest0-21swapper/221:43:152
11862992323,0cyclictest0-21swapper/221:16:372
11862992321,1cyclictest3485-21cron21:05:012
11862992321,1cyclictest0-21swapper/222:15:142
11862992321,1cyclictest0-21swapper/221:35:332
11862992321,1cyclictest0-21swapper/200:06:542
11862992320,2cyclictest20819-21sh22:21:412
11862992320,2cyclictest13339-21ssh22:46:512
11862992320,2cyclictest0-21swapper/200:11:032
1186299230,23cyclictest15341-21ssh23:16:552
1186299230,22cyclictest8014-21sh22:42:142
1186299230,22cyclictest26742-21ssh22:26:362
1186299230,22cyclictest15191-21ssh23:45:142
1186299230,22cyclictest0-21swapper/222:12:112
1186299230,22cyclictest0-21swapper/220:47:492
1186299230,22cyclictest0-21swapper/200:29:102
1186299230,0cyclictest5884-21diskmemload00:33:462
1186299230,0cyclictest0-21swapper/223:02:462
1186299230,0cyclictest0-21swapper/221:45:492
1186299230,0cyclictest0-21swapper/200:22:072
11860992323,0cyclictest0-21swapper/123:31:071
11860992323,0cyclictest0-21swapper/123:21:001
11860992323,0cyclictest0-21swapper/122:51:291
11860992323,0cyclictest0-21swapper/122:24:061
11860992323,0cyclictest0-21swapper/121:57:461
11860992323,0cyclictest0-21swapper/121:38:091
11860992323,0cyclictest0-21swapper/121:10:091
11860992321,1cyclictest8873-21ssh21:42:061
11860992321,1cyclictest7434-21sensors00:38:011
11860992321,1cyclictest3993-21apt-get21:07:571
11860992321,1cyclictest30537-21sh22:01:121
11860992321,1cyclictest0-21swapper/122:25:021
11860992320,2cyclictest2754-21rm22:35:201
11860992320,2cyclictest15766-21ssh23:17:361
1186099230,2cyclictest4074-21sh22:06:411
1186099230,23cyclictest5884-21diskmemload00:27:001
1186099230,23cyclictest0-21swapper/100:10:361
1186099230,23cyclictest0-21swapper/100:08:351
1186099230,23cyclictest0-21swapper/100:01:201
1186099230,22cyclictest8152-21ssh22:42:261
1186099230,22cyclictest31917-21ssh22:31:041
1186099230,22cyclictest29007-21apt-get23:00:021
1186099230,22cyclictest24240-21sh00:23:271
1186099230,1cyclictest313-21systemd-journal00:20:011
1186099230,0cyclictest0-21swapper/121:27:011
11858992323,0cyclictest3406-21ssh22:36:090
11858992323,0cyclictest0-21swapper/021:18:540
11858992320,3cyclictest18619-21ssh21:50:120
11858992320,2cyclictest5884-21diskmemload00:27:070
11858992319,3cyclictest0-21swapper/023:10:130
11858992318,4cyclictest5884-21diskmemload00:05:220
1185899230,23cyclictest0-21swapper/023:25:440
1185899230,23cyclictest0-21swapper/022:25:370
1185899230,23cyclictest0-21swapper/022:11:040
1185899230,22cyclictest5475-21ssh23:37:130
1185899230,22cyclictest17927-21sh23:47:560
1185899230,20cyclictest5884-21diskmemload21:46:530
1185899230,0cyclictest5884-21diskmemload23:32:170
11866992222,0cyclictest0-21swapper/323:51:023
11866992222,0cyclictest0-21swapper/323:07:163
11866992222,0cyclictest0-21swapper/321:48:473
11866992222,0cyclictest0-21swapper/321:10:173
11866992221,0cyclictest0-21swapper/300:37:533
11866992220,1cyclictest5884-21diskmemload00:00:033
11866992220,1cyclictest26489-21ssh22:26:173
11866992220,1cyclictest0-21swapper/322:50:023
11866992219,2cyclictest6605-21ssh22:40:163
11866992219,2cyclictest30727-21munin-run20:55:003
1186699220,2cyclictest17625-21ssh21:20:203
1186699220,22cyclictest0-21swapper/321:37:483
1186699220,22cyclictest0-21swapper/300:29:293
1186699220,21cyclictest5884-21diskmemload00:31:033
1186699220,21cyclictest0-21swapper/322:05:113
1186699220,1cyclictest20303-21sh00:20:303
1186699220,1cyclictest0-21swapper/322:24:323
11862992220,1cyclictest0-21swapper/223:20:012
11862992220,1cyclictest0-21swapper/220:15:002
1186299221,1cyclictest32340-21ssh23:32:182
1186299220,22cyclictest0-21swapper/223:42:222
1186299220,21cyclictest17491-21apt-get19:22:502
1186299220,21cyclictest14789-21ssh00:15:312
1186299220,21cyclictest0-21swapper/223:50:032
1186299220,21cyclictest0-21swapper/222:30:062
1186299220,1cyclictest5884-21diskmemload00:37:452
1186299220,1cyclictest3577-21ssh23:06:042
1186299220,1cyclictest0-21swapper/221:56:582
11860992221,1cyclictest0-21swapper/123:10:061
11860992220,1cyclictest28307-21turbostat20:50:001
1186099220,22cyclictest0-21swapper/121:16:101
1186099220,21cyclictest4340-21apt-get20:02:511
1186099220,21cyclictest29547-21runrttasks19:47:521
1186099220,21cyclictest0-21swapper/123:46:481
1186099220,21cyclictest0-21swapper/123:38:091
1186099220,21cyclictest0-21swapper/121:30:051
1186099220,21cyclictest0-21swapper/121:02:501
1186099220,21cyclictest0-21swapper/120:12:511
1186099220,21cyclictest0-21swapper/119:52:501
1186099220,1cyclictest0-21swapper/122:15:421
1186099220,1cyclictest0-21swapper/121:45:441
11858992222,0cyclictest0-21swapper/022:18:450
11858992220,1cyclictest24261-21apt19:35:010
11858992220,1cyclictest23496-21systemctl20:40:000
11858992220,1cyclictest18669-21munin-run20:30:010
11858992218,3cyclictest0-21swapper/019:20:020
1185899220,22cyclictest0-21swapper/023:52:290
1185899220,21cyclictest5884-21diskmemload22:20:010
1185899220,21cyclictest5884-21diskmemload22:00:100
1185899220,21cyclictest19195-21apt-get20:32:520
1185899220,21cyclictest0-21swapper/020:20:020
1185899220,1cyclictest26298-21ssh23:55:010
1185899220,1cyclictest16621-21grep19:20:000
1185899220,1cyclictest12283-21apt19:12:510
11866992119,1cyclictest23531-21munin-run20:40:003
11862992119,1cyclictest1925-21apt-get19:57:522
1186299210,20cyclictest0-21swapper/221:07:572
1186299210,1cyclictest5884-21diskmemload00:00:362
11860992121,0cyclictest0-21swapper/120:42:511
11860992120,0cyclictest31186-21apt-get20:57:511
1186099210,0cyclictest0-21swapper/121:50:231
1186099210,0cyclictest0-21swapper/119:22:511
1185899210,0cyclictest0-21swapper/020:47:490
11866992020,0cyclictest0-21swapper/320:27:523
11866992018,1cyclictest29072-21dump-pmu-power19:45:013
1186699200,20cyclictest0-21swapper/319:32:503
1186299200,19cyclictest1411-21cron19:55:002
11860992020,0cyclictest0-21swapper/120:52:551
11860992020,0cyclictest0-21swapper/120:07:521
1186099200,20cyclictest0-21swapper/120:17:511
11858992020,0cyclictest0-21swapper/021:07:570
11858992020,0cyclictest0-21swapper/020:52:550
1185899200,19cyclictest26646-21sh19:40:010
11866991919,0cyclictest0-21swapper/319:57:523
11866991919,0cyclictest0-21swapper/319:17:513
11866991918,1cyclictest12284-21apt-get19:12:513
11862991919,0cyclictest21588-21apt-get20:37:532
11862991919,0cyclictest0-21swapper/219:37:522
11862991917,1cyclictest0-21swapper/220:17:512
11860991919,0cyclictest0-21swapper/119:32:501
11860991917,1cyclictest606-21dbus-daemon19:45:011
11858991919,0cyclictest0-21swapper/019:47:520
11866991818,0cyclictest0-21swapper/320:47:483
11866991818,0cyclictest0-21swapper/319:55:003
11866991817,1cyclictest1577-21apt-get21:02:503
11866991816,1cyclictest19479-21munin-run19:25:013
1186299180,18cyclictest0-21swapper/220:02:502
11860991818,0cyclictest0-21swapper/119:37:521
11860991818,0cyclictest0-21swapper/119:12:511
11858991818,0cyclictest0-21swapper/020:57:510
11866991715,1cyclictest0-21swapper/320:10:003
1186699170,16cyclictest0-21swapper/320:02:503
11862991717,0cyclictest0-21swapper/220:57:512
11862991716,1cyclictest14347-21apt-get20:22:492
11862991716,0cyclictest0-21swapper/219:12:512
11862991715,1cyclictest24005-21apt-get20:42:512
11860991717,0cyclictest0-21swapper/120:22:491
11860991716,0cyclictest0-21swapper/119:27:501
11860991716,0cyclictest0-21swapper/119:27:501
11858991717,0cyclictest0-21swapper/020:02:510
11858991717,0cyclictest0-21swapper/019:57:520
11858991717,0cyclictest0-21swapper/019:27:500
11858991717,0cyclictest0-21swapper/019:27:500
11858991712,4cyclictest24005-21apt-get20:42:510
11866991615,1cyclictest13466-21apt-get20:20:023
11866991614,1cyclictest0-21swapper/319:47:543
1186699160,15cyclictest0-21swapper/321:00:003
11862991614,1cyclictest0-21swapper/220:35:012
1186099160,15cyclictest0-21swapper/120:32:561
11858991616,0cyclictest0-21swapper/021:02:500
1185899160,14cyclictest0-21swapper/020:11:000
11866991515,0cyclictest0-21swapper/320:12:513
11862991515,0cyclictest22342-21apt-get19:32:502
11862991515,0cyclictest0-21swapper/220:26:262
1185899150,1cyclictest28320-21pmu-power19:42:580
1186699140,14cyclictest0-21swapper/320:30:253
1186699140,14cyclictest0-21swapper/320:15:033
1186699140,14cyclictest0-21swapper/319:35:133
1186699140,0cyclictest0-21swapper/320:41:063
1186299140,14cyclictest0-21swapper/220:05:182
1186299140,14cyclictest0-21swapper/219:45:502
1186299140,14cyclictest0-21swapper/219:26:172
1186299140,14cyclictest0-21swapper/219:26:172
1186299140,0cyclictest0-21swapper/220:50:562
1186299140,0cyclictest0-21swapper/219:40:032
1186299140,0cyclictest0-21swapper/219:15:042
11860991414,0cyclictest0-21swapper/120:35:041
1186099140,14cyclictest0-21swapper/119:55:081
1186099140,0cyclictest0-21swapper/120:25:151
1185899140,14cyclictest0-21swapper/019:50:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional