You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 15:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon Aug 31, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
127349910531050,3cyclictest19577-21kworker/1:1+events11:16:291
127349910531050,2cyclictest26651-21kworker/1:2+events11:01:501
127349910531049,2cyclictest30056-21kworker/1:2+events12:21:291
127349910531049,2cyclictest20298-21kworker/1:0+events11:26:171
127439910521050,2cyclictest3693-21kworker/3:2+events08:16:373
127439910521049,3cyclictest7895-21kworker/3:2+events10:45:453
127349910521049,2cyclictest19577-21kworker/1:1+events11:05:231
127439910511049,2cyclictest22483-21kworker/3:0+events12:30:463
127349910511048,2cyclictest20298-21kworker/1:0+events11:24:451
127439910501049,1cyclictest29571-21kworker/3:2+events09:46:383
127349910501048,2cyclictest26651-21kworker/1:2+events10:15:441
127439910491048,1cyclictest24685-21kworker/3:0+events09:41:073
127349910481046,2cyclictest8318-21kworker/1:0+events12:15:441
127349910481046,2cyclictest26651-21kworker/1:2+events11:12:551
127439910471044,3cyclictest17760-21kworker/3:2+events09:10:433
127439910391036,3cyclictest17760-21kworker/3:2+events09:20:213
127439910341031,3cyclictest17760-21kworker/3:2+events09:27:583
127439910311029,2cyclictest17760-21kworker/3:2+events09:05:223
127439910291027,2cyclictest7895-21kworker/3:2+events10:56:153
127439910291027,2cyclictest19961-21turbostat08:49:563
127439910291026,3cyclictest25983-21kworker/3:1+events10:40:443
127439910281025,3cyclictest25983-21kworker/3:1+events10:33:493
127439910281025,3cyclictest17760-21kworker/3:2+events09:31:063
127439910251022,3cyclictest7895-21kworker/3:2+events12:28:213
127439910251022,3cyclictest18603-21kworker/3:1+events08:06:083
127399910241022,2cyclictest10335-21kworker/2:1+events11:45:422
127319910231022,1cyclictest511-21kworker/0:2+events09:58:410
127319910231022,1cyclictest23570-21kworker/0:0+events10:25:410
127439910221020,2cyclictest12379-21kworker/3:2+events07:12:363
127439910211019,2cyclictest7895-21kworker/3:2+events10:38:463
127439910211019,2cyclictest11601-21kworker/3:0+events08:22:123
127399910211020,1cyclictest10335-21kworker/2:1+events11:44:552
127319910211020,1cyclictest18683-21kworker/0:1+events10:13:040
127439910201017,3cyclictest7895-21kworker/3:2+events10:54:053
127439910201016,4cyclictest25688-21turbostat10:19:553
127439910191017,2cyclictest10331-21kworker/3:0+events07:19:143
127439910191016,3cyclictest18603-21kworker/3:1+events08:11:053
127439910181016,2cyclictest17163-21kworker/3:1+events12:39:273
127319910171016,1cyclictest31089-21kworker/0:2+events10:22:120
127439910161014,2cyclictest17760-21kworker/3:2+events09:04:323
127439910161013,3cyclictest25983-21kworker/3:1+events09:39:443
127439910161013,3cyclictest11850-21turbostat10:04:553
127439910141011,3cyclictest10331-21kworker/3:0+events07:20:233
127439910131011,2cyclictest3374-21turbostat12:14:553
127439910131010,3cyclictest18603-21kworker/3:1+events08:03:513
127439910121009,3cyclictest11601-21kworker/3:0+events08:25:543
127439910081006,2cyclictest17760-21kworker/3:2+events09:17:183
127439910081006,2cyclictest13662-21kworker/3:1+events08:32:543
127319910051004,1cyclictest511-21kworker/0:2+events09:50:210
127439910031001,2cyclictest11601-21kworker/3:0+events08:38:173
127399910031002,1cyclictest27432-21kworker/2:2+events07:30:212
127439910021000,2cyclictest11601-21kworker/3:0+events08:40:233
12739991002999,3cyclictest31423-21turbostat10:59:552
127399910021001,1cyclictest20582-21kworker/2:2+events11:53:462
12739991001999,2cyclictest14666-21turbostat07:19:552
127399910011000,1cyclictest18699-21kworker/2:1+events07:26:282
1273999999998,1cyclictest24831-21kworker/2:0+events07:40:222
1273999997997,0cyclictest31232-21kworker/2:2+events11:32:402
1273499996994,2cyclictest917-21turbostat08:04:561
1273199995994,1cyclictest26905-21kworker/0:0+events12:05:540
1273999991990,1cyclictest5453-21kworker/2:0+events11:36:042
1273999989987,2cyclictest10335-21kworker/2:1+events11:57:472
1273999988987,1cyclictest18699-21kworker/2:1+events07:35:432
1274399987985,2cyclictest25246-21turbostat07:44:563
1274399978975,3cyclictest21103-21turbostat10:14:553
1273199975972,3cyclictest28037-21turbostat09:09:550
1273199968965,3cyclictest7958-21turbostat12:19:550
1273199966965,1cyclictest27513-21kworker/0:1+events07:46:160
1273199962960,2cyclictest5399-21turbostat08:14:560
1273199962960,2cyclictest15584-21kworker/0:1+events12:01:490
1273199958957,1cyclictest27513-21kworker/0:1+events07:58:190
1273199952951,1cyclictest511-21kworker/0:2+events10:02:200
1273199948947,1cyclictest511-21kworker/0:2+events10:08:180
1273199944943,1cyclictest2818-21kworker/0:0+events07:52:230
1273199941940,1cyclictest25642-21kworker/0:1+events08:59:370
1273199937936,1cyclictest15584-21kworker/0:1+events12:11:060
1273999930927,3cyclictest31299-21turbostat07:59:562
1273199929928,1cyclictest22212-21kworker/0:0+events08:52:120
1273199925922,3cyclictest7547-21turbostat10:34:550
1273999917915,2cyclictest26535-21turbostat12:04:552
1273499915912,2cyclictest16692-21turbostat07:24:561
1273199915914,1cyclictest21970-21turbostat11:59:550
1274399912908,4cyclictest26720-21turbostat11:29:553
1273499899896,3cyclictest23998-21turbostat08:59:561
1273499878877,1cyclictest17926-21turbostat08:44:561
1273499864861,2cyclictest2946-21turbostat10:29:541
1273199704700,4cyclictest19961-21turbostat08:49:560
1273199661658,3cyclictest25246-21turbostat07:44:560
1274399655652,3cyclictest12583-21turbostat12:24:553
1273499619618,1cyclictest31423-21turbostat10:59:551
1273199617615,2cyclictest30476-21turbostat09:49:550
1273499614612,2cyclictest3374-21turbostat12:14:551
1274399610606,2cyclictest23998-21turbostat08:59:563
1273999603602,1cyclictest16692-21turbostat07:24:562
1273499578576,2cyclictest21103-21turbostat10:14:551
1274399571569,2cyclictest2946-21turbostat10:29:553
1274399501500,1cyclictest31299-21turbostat07:59:563
1273199491488,3cyclictest25688-21turbostat10:19:550
1273999370369,1cyclictest26720-21turbostat11:29:552
12743992018,2cyclictest67750irq/123-lan11:33:163
12743992017,3cyclictest67750irq/123-lan11:55:133
12743991919,0cyclictest67750irq/123-lan10:05:113
12743991917,2cyclictest67750irq/123-lan12:07:423
12743991917,2cyclictest67750irq/123-lan09:52:083
12743991818,0cyclictest67750irq/123-lan11:11:353
12743991817,1cyclictest67750irq/123-lan11:15:203
12743991817,1cyclictest67750irq/123-lan10:24:293
12743991816,2cyclictest67750irq/123-lan12:01:533
12743991816,2cyclictest67750irq/123-lan11:03:393
12739991818,0cyclictest3758-21cat10:25:132
12743991717,0cyclictest67750irq/123-lan11:40:183
12743991717,0cyclictest67750irq/123-lan11:22:103
12743991716,1cyclictest67750irq/123-lan12:20:003
12743991716,1cyclictest67750irq/123-lan11:54:133
12743991715,2cyclictest67750irq/123-lan11:35:283
12743991715,2cyclictest67750irq/123-lan07:30:223
12739991717,0cyclictest784-21snmpd11:05:232
12739991717,0cyclictest784-21snmpd11:00:462
12739991717,0cyclictest784-21snmpd09:43:002
12739991717,0cyclictest784-21snmpd09:09:472
12739991717,0cyclictest12730-21cat10:00:132
12739991716,1cyclictest784-21snmpd10:35:582
12743991616,0cyclictest67750irq/123-lan11:47:553
12743991615,1cyclictest67750irq/123-lan09:59:303
12743991614,2cyclictest67750irq/123-lan11:05:083
12743991614,2cyclictest67750irq/123-lan08:50:133
12743991614,2cyclictest67750irq/123-lan07:45:143
12739991616,0cyclictest784-21snmpd12:17:522
12739991616,0cyclictest784-21snmpd11:10:532
12739991616,0cyclictest784-21snmpd09:31:442
12739991616,0cyclictest784-21snmpd09:23:322
12739991616,0cyclictest784-21snmpd08:37:462
12743991514,1cyclictest67750irq/123-lan07:25:153
12743991513,2cyclictest67750irq/123-lan07:35:113
12743991412,2cyclictest67750irq/123-lan07:50:143
127399998,1cyclictest784-21snmpd08:23:012
127399998,1cyclictest782-21lldpd08:29:482
127399996,3cyclictest762-21ntpd07:49:222
127349998,1cyclictest782-21lldpd07:53:081
127349990,9cyclictest15993-21switchtime07:15:211
127319998,1cyclictest784-21snmpd09:15:380
127319998,1cyclictest782-21lldpd11:22:090
127319998,1cyclictest782-21lldpd07:15:010
127399988,0cyclictest782-21lldpd11:15:512
127399988,0cyclictest782-21lldpd10:43:522
127399986,2cyclictest784-21snmpd12:20:072
127399986,2cyclictest784-21snmpd08:10:302
127399986,2cyclictest762-21ntpd09:00:552
127399986,2cyclictest762-21ntpd08:57:112
127399986,2cyclictest762-21ntpd08:51:222
127399986,2cyclictest762-21ntpd08:45:552
127399986,2cyclictest762-21ntpd08:30:322
127399986,2cyclictest762-21ntpd07:50:562
127399985,2cyclictest762-21ntpd08:15:052
127349988,0cyclictest782-21lldpd09:37:571
127349988,0cyclictest782-21lldpd08:11:521
127349987,1cyclictest784-21snmpd10:54:381
127349987,1cyclictest526-21avahi-daemon11:47:521
127349987,1cyclictest526-21avahi-daemon09:30:111
127349987,1cyclictest507-21systemd-resolve12:00:341
127349986,2cyclictest784-21snmpd09:58:361
127319988,0cyclictest784-21snmpd10:45:560
127319988,0cyclictest782-21lldpd11:11:230
127319988,0cyclictest782-21lldpd09:39:190
127319987,1cyclictest784-21snmpd08:25:250
127319987,1cyclictest782-21lldpd08:41:570
127319987,1cyclictest782-21lldpd08:31:540
127319986,2cyclictest784-21snmpd11:40:180
127319986,2cyclictest784-21snmpd09:12:410
127319986,2cyclictest784-21snmpd09:03:590
127319986,2cyclictest784-21snmpd07:30:430
127399977,0cyclictest784-21snmpd07:12:102
127399976,1cyclictest784-21snmpd10:31:252
127399976,1cyclictest526-21avahi-daemon10:08:022
127399976,1cyclictest507-21systemd-resolve09:59:372
127399976,1cyclictest28196-21pmu-power10:50:192
127399976,1cyclictest26710-21idleruntime-cro11:25:002
127399975,2cyclictest784-21snmpd10:23:192
127399975,2cyclictest784-21snmpd09:35:332
127349977,0cyclictest784-21snmpd11:55:131
127349977,0cyclictest784-21snmpd09:21:171
127349977,0cyclictest782-21lldpd12:08:461
127349977,0cyclictest782-21lldpd10:09:091
127349977,0cyclictest782-21lldpd09:50:051
127349977,0cyclictest782-21lldpd07:42:201
127349976,1cyclictest784-21snmpd11:35:031
127349976,1cyclictest784-21snmpd09:01:411
127349976,1cyclictest782-21lldpd08:45:051
127349976,1cyclictest507-21systemd-resolve11:52:061
127349976,1cyclictest507-21systemd-resolve10:22:371
127349976,1cyclictest245-20systemd-journal12:30:171
127349976,1cyclictest22468-21fschecks_time08:50:131
127349975,2cyclictest784-21snmpd08:30:521
127349975,2cyclictest784-21snmpd08:05:091
127319977,0cyclictest784-21snmpd09:41:150
127319977,0cyclictest782-21lldpd12:25:580
127319977,0cyclictest782-21lldpd09:21:270
127319977,0cyclictest782-21lldpd08:35:140
127319976,1cyclictest784-21snmpd11:06:590
127319976,1cyclictest784-21snmpd09:28:590
127319976,1cyclictest526-21avahi-daemon07:20:170
127319976,1cyclictest526-21avahi-daemon07:14:040
127319975,2cyclictest784-21snmpd11:28:120
127319975,2cyclictest784-21snmpd08:02:540
127399963,3cyclictest547-21NetworkManager09:53:472
127399963,3cyclictest19047-21users12:25:232
127399963,2cyclictest19001-21sed08:40:172
127399962,3cyclictest6378-21ssh12:12:222
127399962,3cyclictest510-21ssh09:46:292
127399960,5cyclictest7319-21ssh09:19:542
127349966,0cyclictest782-21lldpd12:27:461
127349965,1cyclictest784-21snmpd10:45:321
127349965,1cyclictest784-21snmpd09:25:411
127349965,1cyclictest784-21snmpd09:05:051
127349965,1cyclictest782-21lldpd12:38:461
127349965,1cyclictest782-21lldpd09:47:321
127349964,2cyclictest784-21snmpd08:19:481
127349964,2cyclictest784-21snmpd07:55:261
127349964,2cyclictest13345-21sshd10:35:171
127349963,3cyclictest547-21NetworkManager11:40:061
127349963,3cyclictest13537-21grep07:10:151
127349963,2cyclictest6426-21ssh09:18:231
127349963,2cyclictest574-21rs:main1
127349963,2cyclictest32711-21ssh09:10:591
127349963,2cyclictest245-20systemd-journal10:00:371
127349962,3cyclictest11267-21sed08:20:211
127349961,4cyclictest14041-21cat08:30:011
127319966,0cyclictest784-21snmpd11:31:570
127319966,0cyclictest782-21lldpd12:35:040
127319966,0cyclictest782-21lldpd12:20:060
127319965,1cyclictest784-21snmpd11:36:090
127319965,1cyclictest784-21snmpd11:16:210
127319965,1cyclictest526-21avahi-daemon08:15:400
127319965,1cyclictest13593-21cat11:45:130
127319964,2cyclictest784-21snmpd11:01:110
127319963,2cyclictest24284-21ssh12:31:260
127399955,0cyclictest784-21snmpd09:10:042
127399955,0cyclictest2003-21gltestperf08:00:142
127399954,1cyclictest25174-21kworker/u16:1-writeback10:16:482
127399954,1cyclictest23001-21ntp_kernel_pll_10:45:172
127399954,1cyclictest0-21swapper/210:10:122
127399952,2cyclictest32366-21ldconfig12:05:172
127399952,2cyclictest28566-21ssh12:35:542
127399952,2cyclictest23754-21rm12:30:332
127399952,2cyclictest13806-21sed09:25:192
127349955,0cyclictest784-21snmpd07:35:071
127349953,2cyclictest784-21snmpd10:42:561
127349952,2cyclictest8251-21gltestperf10:30:151
127349952,2cyclictest245-20systemd-journal08:38:031
127349951,3cyclictest27541-21apt-get07:45:121
127349950,4cyclictest31663-21apt-get11:30:121
127349950,3cyclictest21172-21awk07:30:011
127319955,0cyclictest782-21lldpd10:40:160
127319955,0cyclictest782-21lldpd10:38:060
127319954,1cyclictest27357-21cut10:50:130
127319952,3cyclictest32651-21ntpq10:55:180
127319952,2cyclictest574-21rs:main0
127319952,2cyclictest4974-21sed08:05:210
127319952,2cyclictest18601-21awk11:50:180
127319952,2cyclictest10445-21tail08:20:140
127319952,0cyclictest19004-21ssh09:31:160
127399940,3cyclictest3939-21fw_forwarded_lo08:05:142
127349941,2cyclictest21735-21tail07:30:141
127319941,2cyclictest19121-21dpkg07:25:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional