You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 08:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Sep 22, 2026 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110609910511049,2cyclictest2674-21kworker/2:1+events20:42:442
110609910511049,2cyclictest2674-21kworker/2:1+events00:25:222
110609910511049,2cyclictest13565-21kworker/2:0+events20:35:452
110649910501049,1cyclictest11134-21kworker/3:2+events20:31:293
110559910501049,1cyclictest24771-21kworker/1:0+events22:12:581
110559910451043,2cyclictest22589-21turbostat00:24:561
110609910441041,3cyclictest10068-21turbostat23:39:552
110649910391038,1cyclictest30270-21kworker/3:1+events20:08:433
110649910381036,2cyclictest11968-21turbostat23:09:553
110649910351033,2cyclictest24958-21kworker/3:1+events22:56:523
110559910351034,1cyclictest20106-21kworker/1:1+events00:19:481
110649910341033,1cyclictest24958-21kworker/3:1+events22:53:483
110559910321029,3cyclictest20254-21turbostat21:39:551
110649910281026,2cyclictest2801-21turbostat00:04:553
110479910281027,1cyclictest25134-21kworker/0:1+events22:26:370
110479910241022,2cyclictest25134-21kworker/0:1+events22:22:150
110479910231022,1cyclictest29122-21kworker/0:2+events23:58:380
110479910231022,1cyclictest15289-21kworker/0:1+events19:20:430
110479910231021,2cyclictest16098-21kworker/0:0+events23:44:130
110479910221021,1cyclictest16098-21kworker/0:0+events23:45:440
110649910211020,1cyclictest30523-21kworker/3:0+events22:47:523
110609910121010,2cyclictest25456-21turbostat21:09:542
110559910111009,2cyclictest13276-21kworker/1:1+events23:38:411
110649910101009,1cyclictest23138-21kworker/3:1+events19:36:053
110559910101006,2cyclictest24214-21kworker/1:0+events23:25:231
110559910071007,0cyclictest18928-21kworker/1:0+events21:57:021
110649910031002,1cyclictest6857-21kworker/3:2+events23:01:273
110559910031002,1cyclictest3223-21kworker/1:0+events00:13:411
110559910031002,1cyclictest3223-21kworker/1:0+events00:13:411
110649910021001,1cyclictest7004-21kworker/3:1+events20:21:493
11055991000999,1cyclictest17478-21kworker/1:1+events23:31:031
11047991000997,3cyclictest31578-21turbostat20:04:550
1106499999998,1cyclictest30523-21kworker/3:0+events22:40:233
1106499995994,1cyclictest7646-21kworker/3:0+events21:23:393
1106499994993,1cyclictest13180-21kworker/3:1+events21:18:463
1105599994993,1cyclictest3223-21kworker/1:0+events00:06:491
1105599994993,1cyclictest24214-21kworker/1:0+events23:19:481
1105599993991,2cyclictest23410-21turbostat21:04:551
1106499992991,1cyclictest13180-21kworker/3:1+events21:27:413
1106499991990,1cyclictest7646-21kworker/3:0+events21:34:463
1106499991990,1cyclictest30270-21kworker/3:1+events19:57:013
1105599991990,1cyclictest17478-21kworker/1:1+events23:21:071
1105599991990,1cyclictest12910-21kworker/1:2+events22:00:421
1104799991989,2cyclictest17623-21kworker/0:0+events20:58:180
1106499990989,1cyclictest17023-21kworker/3:0+events20:29:303
1105599990989,1cyclictest17478-21kworker/1:1+events23:11:161
1106499989988,1cyclictest13180-21kworker/3:1+events21:39:423
1105599989987,2cyclictest12910-21kworker/1:2+events22:06:351
1104799989988,1cyclictest420-21kworker/0:1+events00:37:400
1105599988987,1cyclictest24771-21kworker/1:0+events22:18:501
1106499986985,1cyclictest4948-21kworker/3:2+events20:15:223
1106499986985,1cyclictest24870-21kworker/3:2+events21:40:203
1105599985984,1cyclictest2144-21kworker/1:1+events19:10:231
1106499984983,1cyclictest30523-21kworker/3:0+events21:52:123
1105599984983,1cyclictest14664-21kworker/1:2+events19:46:491
1106499983982,1cyclictest30523-21kworker/3:0+events21:46:163
1106499982981,1cyclictest13180-21kworker/3:1+events21:11:493
1105599982979,2cyclictest12105-21kworker/1:2+events22:38:271
1106499981980,1cyclictest17023-21kworker/3:0+events19:53:493
1106499981980,1cyclictest17023-21kworker/3:0+events19:42:333
1106499981980,1cyclictest17023-21kworker/3:0+events19:31:053
1105599980979,1cyclictest14664-21kworker/1:2+events19:17:451
1105599980979,1cyclictest13276-21kworker/1:1+events00:00:231
1104799980979,1cyclictest25134-21kworker/0:1+events22:31:370
1106499975974,1cyclictest2837-21kworker/3:1+events19:26:083
1104799974973,1cyclictest16098-21kworker/0:0+events23:51:510
1104799974971,3cyclictest2044-21turbostat22:59:540
1104799973973,0cyclictest25134-21kworker/0:1+events23:09:420
1104799973972,1cyclictest25134-21kworker/0:1+events21:03:520
1106499971970,1cyclictest30270-21kworker/3:1+events20:01:063
1104799971970,1cyclictest15289-21kworker/0:1+events20:45:220
1106499970969,1cyclictest30270-21kworker/3:1+events20:11:063
1104799970969,1cyclictest15289-21kworker/0:1+events20:50:190
1104799966965,1cyclictest17623-21kworker/0:0+events21:06:370
1104799964963,1cyclictest420-21kworker/0:1+events00:33:170
1104799963960,3cyclictest2667-21turbostat21:54:550
1105599960959,1cyclictest17043-21turbostat19:29:561
1104799941939,2cyclictest21507-21turbostat19:39:550
1106499938936,2cyclictest15341-21turbostat20:44:553
1106499937935,2cyclictest16890-21turbostat23:14:543
1106499933932,1cyclictest9816-21turbostat22:34:553
1106499918916,2cyclictest12993-21turbostat19:19:553
1106499876873,3cyclictest30281-21turbostat23:59:563
1106499874872,2cyclictest27545-21turbostat00:29:563
1104799872870,2cyclictest25546-21turbostat19:49:560
1105599871868,3cyclictest13328-21turbostat20:39:551
1104799863860,3cyclictest14753-21turbostat22:39:540
1106499853851,2cyclictest25343-21turbostat23:54:563
1104799694693,1cyclictest10068-21turbostat23:39:550
1106099692689,3cyclictest22589-21turbostat00:24:562
1105599692690,2cyclictest9816-21turbostat22:34:551
1104799688685,3cyclictest15341-21turbostat20:44:550
1104799673671,2cyclictest7017-21turbostat23:04:550
1106499670668,2cyclictest25456-21turbostat21:09:543
1104799668665,3cyclictest12993-21turbostat19:19:550
1105599634631,3cyclictest30281-21turbostat23:59:561
1106499633631,2cyclictest25546-21turbostat19:49:563
1104799623621,2cyclictest27545-21turbostat00:29:560
1106499622621,1cyclictest14753-21turbostat22:39:543
1106099606605,1cyclictest11325-21turbostat20:34:552
1105599596594,2cyclictest11968-21turbostat23:09:551
1105599526525,1cyclictest2667-21turbostat21:54:551
1105599526524,2cyclictest23506-21turbostat19:44:551
1104799502501,1cyclictest27399-21turbostat22:19:550
1106499484481,2cyclictest15009-21turbostat19:24:553
11055991918,1cyclictest67750irq/123-lan23:50:191
11055991918,1cyclictest67750irq/123-lan22:40:171
11055991918,1cyclictest67750irq/123-lan21:46:051
11055991818,0cyclictest67750irq/123-lan21:31:001
11055991818,0cyclictest67750irq/123-lan20:00:241
11055991817,1cyclictest67750irq/123-lan23:46:241
11055991817,1cyclictest67750irq/123-lan20:25:171
11055991817,1cyclictest67750irq/123-lan19:30:141
11055991817,1cyclictest67750irq/123-lan00:25:491
11055991717,0cyclictest67750irq/123-lan23:41:201
11055991717,0cyclictest67750irq/123-lan23:04:071
11055991717,0cyclictest67750irq/123-lan22:27:281
11055991717,0cyclictest67750irq/123-lan22:20:101
11055991717,0cyclictest67750irq/123-lan21:18:581
11055991717,0cyclictest67750irq/123-lan21:11:171
11055991717,0cyclictest67750irq/123-lan19:50:161
11055991716,1cyclictest67750irq/123-lan22:50:561
11055991716,1cyclictest67750irq/123-lan21:25:211
11055991716,1cyclictest67750irq/123-lan20:50:121
11055991716,1cyclictest67750irq/123-lan00:35:121
11055991716,1cyclictest67750irq/123-lan00:30:261
11055991616,0cyclictest67750irq/123-lan21:40:201
11055991616,0cyclictest67750irq/123-lan20:15:181
11055991616,0cyclictest67750irq/123-lan19:55:161
11055991615,1cyclictest67750irq/123-lan22:55:141
11055991615,1cyclictest67750irq/123-lan22:45:131
11055991615,1cyclictest67750irq/123-lan21:05:111
11055991515,0cyclictest67750irq/123-lan20:40:151
11055991514,1cyclictest67750irq/123-lan21:21:281
11055991514,1cyclictest67750irq/123-lan20:05:191
11055991414,0cyclictest67750irq/123-lan19:35:161
11055991413,1cyclictest67750irq/123-lan19:20:111
11055991313,0cyclictest67750irq/123-lan20:30:211
11055991312,1cyclictest67750irq/123-lan20:10:111
11055991212,0cyclictest67750irq/123-lan20:56:451
11055991212,0cyclictest67750irq/123-lan20:22:281
11055991111,0cyclictest67750irq/123-lan20:45:201
110649998,1cyclictest784-21snmpd22:26:053
110649996,3cyclictest784-21snmpd23:35:083
110609998,1cyclictest784-21snmpd22:07:592
110649988,0cyclictest784-21snmpd19:11:093
110649988,0cyclictest784-21snmpd00:08:093
110649988,0cyclictest782-21lldpd21:03:023
110649987,1cyclictest784-21snmpd23:20:043
110649987,1cyclictest526-21avahi-daemon22:21:343
110649987,1cyclictest526-21avahi-daemon22:18:303
110649987,1cyclictest507-21systemd-resolve00:14:113
110649987,1cyclictest507-21systemd-resolve00:14:113
110609988,0cyclictest784-21snmpd19:51:082
110609988,0cyclictest782-21lldpd23:59:142
110609988,0cyclictest782-21lldpd21:22:352
110609988,0cyclictest782-21lldpd20:16:592
110609987,1cyclictest784-21snmpd23:12:062
110609987,1cyclictest784-21snmpd22:02:432
110609987,1cyclictest784-21snmpd20:59:322
110609987,1cyclictest526-21avahi-daemon22:25:342
110609986,2cyclictest784-21snmpd23:52:562
110609986,2cyclictest784-21snmpd22:46:542
110609986,2cyclictest784-21snmpd21:30:582
110609986,2cyclictest784-21snmpd21:13:272
110479988,0cyclictest784-21snmpd21:43:210
110479988,0cyclictest784-21snmpd20:22:460
110479987,1cyclictest784-21snmpd20:15:000
110479987,1cyclictest782-21lldpd20:06:410
110479986,2cyclictest784-21snmpd19:27:550
110479986,2cyclictest762-21ntpd21:27:410
110649977,0cyclictest784-21snmpd23:34:143
110649977,0cyclictest784-21snmpd00:35:283
110649977,0cyclictest782-21lldpd23:47:003
110649976,1cyclictest13664-21cpuspeed_turbos20:35:133
110649975,2cyclictest784-21snmpd21:56:433
110649975,2cyclictest784-21snmpd20:55:053
110649975,2cyclictest784-21snmpd20:51:353
110649975,2cyclictest762-21ntpd23:42:363
110649973,3cyclictest245-20systemd-journal22:13:573
110649973,3cyclictest18889-21grep00:15:183
110609977,0cyclictest784-21snmpd22:57:042
110609977,0cyclictest784-21snmpd20:00:062
110609977,0cyclictest784-21snmpd00:39:252
110609977,0cyclictest782-21lldpd23:01:552
110609977,0cyclictest782-21lldpd22:12:222
110609977,0cyclictest782-21lldpd19:35:492
110609977,0cyclictest21447-21needreboot23:45:142
110609976,1cyclictest784-21snmpd21:35:492
110609976,1cyclictest784-21snmpd19:18:572
110609976,1cyclictest782-21lldpd00:18:162
110609976,1cyclictest526-21avahi-daemon22:38:312
110609976,1cyclictest526-21avahi-daemon21:17:452
110609976,1cyclictest1499-21nvmesmart_nvme023:25:172
110609975,2cyclictest784-21snmpd19:31:222
110609975,2cyclictest784-21snmpd19:23:212
110609974,3cyclictest784-21snmpd23:24:172
110609974,3cyclictest547-21NetworkManager23:18:022
110479977,0cyclictest784-21snmpd19:57:200
110479977,0cyclictest782-21lldpd23:17:370
110479977,0cyclictest782-21lldpd22:06:040
110479977,0cyclictest782-21lldpd19:13:000
110479976,1cyclictest784-21snmpd22:00:310
110479975,2cyclictest784-21snmpd19:40:480
110479973,3cyclictest6698-21ntp_states21:20:180
110649965,1cyclictest526-21avahi-daemon22:02:023
110649965,1cyclictest507-21systemd-resolve00:20:183
110649964,2cyclictest784-21snmpd20:47:403
110649964,2cyclictest5124-21cron23:29:593
110649963,2cyclictest3193-21ssh00:32:103
110649963,2cyclictest23529-21ntp_states23:15:183
110609966,0cyclictest782-21lldpd23:06:352
110609966,0cyclictest782-21lldpd22:54:402
110609966,0cyclictest782-21lldpd21:48:142
110609966,0cyclictest782-21lldpd19:55:392
110609966,0cyclictest782-21lldpd00:12:262
110609966,0cyclictest782-21lldpd00:12:262
110609966,0cyclictest782-21lldpd00:05:042
110609965,1cyclictest526-21avahi-daemon20:54:542
110609965,1cyclictest526-21avahi-daemon00:31:472
110609964,2cyclictest784-21snmpd21:42:332
110609964,2cyclictest784-21snmpd20:12:302
110609963,3cyclictest784-21snmpd21:29:532
110609963,3cyclictest28260-21cat22:15:142
110609963,3cyclictest245-20systemd-journal22:41:062
110609963,3cyclictest18474-21ntp_states20:45:172
110609962,3cyclictest7469-21ssh23:31:082
110609962,3cyclictest16697-21ntp_states23:40:162
110609960,5cyclictest23789-21apt-get19:40:112
110479966,0cyclictest784-21snmpd19:52:060
110479966,0cyclictest782-21lldpd00:18:370
110479965,1cyclictest784-21snmpd21:48:090
110479964,2cyclictest784-21snmpd20:32:540
110479963,2cyclictest28154-21ssh22:47:560
110479963,2cyclictest27147-21ssh22:14:390
110479963,2cyclictest2018-21ssh22:54:590
110479963,2cyclictest10657-21ssh00:06:550
110479962,3cyclictest4873-21ssh23:29:380
110479962,3cyclictest23570-21ssh21:37:350
110479962,3cyclictest19304-21ssh23:11:160
110479962,3cyclictest15733-21ssh00:12:090
110479962,3cyclictest15733-21ssh00:12:090
110479962,3cyclictest10881-21ssh21:57:320
110649952,2cyclictest19841-21rm22:06:073
110609954,1cyclictest3086-21cups-browsed00:00:032
110609953,2cyclictest784-21snmpd19:28:192
110609953,2cyclictest784-21snmpd19:13:062
110609952,3cyclictest8923-21grep21:55:192
110609952,2cyclictest2824-21ssh22:21:532
110609952,2cyclictest11259-21ps22:30:222
110609951,3cyclictest7707-21df20:20:132
110609950,4cyclictest3789-21ntpq21:50:162
110479955,0cyclictest16143-21gltestperf21:30:190
110479954,1cyclictest0-21swapper/023:20:180
110479953,2cyclictest762-21ntpd00:20:090
110479953,0cyclictest20235-21ssh22:40:120
110479952,2cyclictest6993-21ssh00:03:510
110479952,2cyclictest6319-21ld20:15:170
110479952,2cyclictest6071-21latency23:30:150
110479952,2cyclictest28239-21ssh21:10:100
110479952,2cyclictest19697-21gpg-connect-age19:30:010
110479952,2cyclictest1068-21cut21:15:130
110479952,2cyclictest10298-21awk20:25:170
110609943,1cyclictest784-21snmpd20:25:012
110609941,2cyclictest23747-21cpuspeed_turbos21:00:132
110609940,4cyclictest1646-21diskstats20:05:142
110609940,3cyclictest26526-21/usr/sbin/munin19:45:162
110479940,3cyclictest13759-21diskstats20:35:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional