You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-07 - 11:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Jun 07, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1567623723,0sleep00-21swapper/018:50:410
304450350,0irq/25-eth10-21swapper/318:48:423
1560523324,0sleep20-21swapper/218:49:542
1589723222,0sleep10-21swapper/118:53:141
4160,0ktimersoftd/00-21swapper/021:56:190
35160,0ktimersoftd/30-21swapper/322:45:563
35160,0ktimersoftd/30-21swapper/320:28:373
339960,0migration/33829-21sh23:44:553
339960,0migration/330051-21sh22:23:063
339960,0migration/327724-21ntp_offset22:38:453
339960,0migration/313235-21sh22:31:433
339960,0migration/311773-21munin-node23:08:483
29725060,0irq/27-eth0-tx-4710-21munin-node19:33:450
29725060,0irq/27-eth0-tx-24702-21munin-node19:48:410
29715060,0irq/26-eth0-rx-22470-21irqrtprio00:18:413
159849960,0cyclictest0-21swapper/223:53:372
149960,0migration/04995-21taskset21:23:520
149960,0migration/04428-21sh22:45:120
149960,0migration/027103-21ntp_offset23:38:450
149960,0migration/020674-21sh22:14:030
4150,0ktimersoftd/00-21swapper/021:09:200
339950,0migration/39629-21kthreadcore22:08:423
339950,0migration/35878-21kthreadcore19:08:423
339950,0migration/35534-21taskset21:46:153
339950,0migration/34654-21runrttasks22:25:023
339950,0migration/34174-21sshd19:30:003
339950,0migration/332614-21kthreadcore22:03:423
339950,0migration/323985-21irqrtprio18:58:413
339950,0migration/323913-21unixbench-2d19:43:483
339950,0migration/320007-21unixbench_singl22:53:473
339950,0migration/318483-21taskset20:05:253
339950,0migration/318024-21if_eth119:18:413
339950,0migration/314818-21munin-node22:13:373
339950,0migration/314553-21latency_hist21:53:253
339950,0migration/311392-21taskset19:38:323
29725050,0irq/27-eth0-tx-18035-21munin-node19:43:440
29725050,0irq/27-eth0-tx-17098-21munin-node19:18:400
29725050,0irq/27-eth0-tx-0-21swapper/223:49:032
29725050,0irq/27-eth0-tx-0-21swapper/020:49:300
29715050,0irq/26-eth0-rx-9112-21kthreadcore20:23:423
29715050,0irq/26-eth0-rx-7940-21sort21:48:423
29715050,0irq/26-eth0-rx-7653-21irqcore21:08:413
29715050,0irq/26-eth0-rx-6766-21irqrtprio23:28:413
29715050,0irq/26-eth0-rx-6559-21runrttasks23:26:173
29715050,0irq/26-eth0-rx-5362-21aten_r1power_cu23:48:373
29715050,0irq/26-eth0-rx-4388-21ntpq21:23:453
29715050,0irq/26-eth0-rx-28710-21ssh20:58:573
29715050,0irq/26-eth0-rx-28710-21ssh20:58:573
29715050,0irq/26-eth0-rx-28678-21open_inodes21:18:433
29715050,0irq/26-eth0-rx-27756-21kthreadcore19:48:423
29715050,0irq/26-eth0-rx-20624-21ssh20:54:163
29715050,0irq/26-eth0-rx-20072-21ssh00:15:493
29715050,0irq/26-eth0-rx-14889-21kernelversion23:33:413
29715050,0irq/26-eth0-rx-14602-21cut23:53:423
29715050,0irq/26-eth0-rx-0-21swapper/323:41:523
29715050,0irq/26-eth0-rx-0-21swapper/323:23:213
29715050,0irq/26-eth0-rx-0-21swapper/323:06:113
29715050,0irq/26-eth0-rx-0-21swapper/322:35:113
29715050,0irq/26-eth0-rx-0-21swapper/321:58:433
29715050,0irq/26-eth0-rx-0-21swapper/321:40:093
29715050,0irq/26-eth0-rx-0-21swapper/321:30:053
29715050,0irq/26-eth0-rx-0-21swapper/321:13:433
29715050,0irq/26-eth0-rx-0-21swapper/321:03:403
29715050,0irq/26-eth0-rx-0-21swapper/321:03:403
29715050,0irq/26-eth0-rx-0-21swapper/300:08:423
29715050,0irq/26-eth0-rx-0-21swapper/300:03:393
249950,0watchdog/211769-21cut21:48:432
19150,0ktimersoftd/10-21swapper/120:28:371
179950,0migration/124705-21if_eth1.319:23:411
179950,0migration/123450-21munin-node21:58:401
169950,0watchdog/12681-21kthreadcore23:23:431
169950,0watchdog/123232-21sed21:38:391
169950,0watchdog/114543-21forks22:33:391
169950,0watchdog/111500-21wc22:28:431
159849950,0cyclictest0-21swapper/222:06:062
159839955,0cyclictest14080-21diskmemload00:00:351
159839955,0cyclictest0-21swapper/121:53:501
159839955,0cyclictest0-21swapper/121:13:191
159839955,0cyclictest0-21swapper/120:48:531
159839950,0cyclictest0-21swapper/123:15:021
159839950,0cyclictest0-21swapper/123:03:311
159839950,0cyclictest0-21swapper/122:20:191
159839950,0cyclictest0-21swapper/122:05:581
159839950,0cyclictest0-21swapper/121:45:571
159829955,0cyclictest0-21swapper/022:19:580
159829955,0cyclictest0-21swapper/000:08:550
159829950,0cyclictest0-21swapper/022:34:000
149950,0migration/0771-21munin-node20:18:400
149950,0migration/07277-21sh21:28:360
149950,0migration/0615-21latency_hist20:43:260
149950,0migration/0501-21kthreadcore22:03:420
149950,0migration/03450-21taskset23:43:580
149950,0migration/031203-21fschecks_count21:03:400
149950,0migration/031203-21fschecks_count21:03:400
149950,0migration/031160-21munin-node20:13:460
149950,0migration/030485-21taskset00:03:410
149950,0migration/030181-21taskset21:42:150
149950,0migration/029441-21latency_hist19:03:260
149950,0migration/027772-21switchtime22:58:470
149950,0migration/024378-21kthreadcore00:18:420
149950,0migration/023374-21cpuspeed_turbos21:18:350
149950,0migration/023293-21kthreadcore20:08:430
149950,0migration/018646-21kthreadcore18:53:420
149950,0migration/018327-21kthreadcore20:53:420
149950,0migration/017718-21kthreadcore22:53:410
149950,0migration/015722-21kthreadcore19:38:440
149950,0migration/015321-21kthreadcore23:33:410
149950,0migration/015275-21kthreadcore20:28:420
149950,0migration/015078-21kthreadcore23:13:410
149950,0migration/014782-21kthreadcore23:53:420
149950,0migration/013376-21taskset23:13:130
149950,0migration/013285-21taskset22:31:520
149950,0migration/011614-21taskset23:49:010
149950,0migration/011413-21switchtime23:28:470
149950,0migration/010428-21kthreadcore20:23:420
8215040,0irq/24-0000:00:0-21swapper/221:58:252
339940,0migration/35549-21kthreadcore20:43:443
339940,0migration/329915-21fschecks_count19:03:393
339940,0migration/320912-21if_eth1.220:33:413
339940,0migration/319467-21kthreadcore18:53:423
339940,0migration/313873-21aten_r1power_vo23:13:363
339940,0migration/310599-21kthreadcore20:48:433
29725040,0irq/27-eth0-tx-7295-21irqcore22:28:412
29725040,0irq/27-eth0-tx-21274-21munin-node00:18:382
29725040,0irq/27-eth0-tx-20550-21ssh20:54:062
29725040,0irq/27-eth0-tx-13158-21ssh00:13:272
29725040,0irq/27-eth0-tx-0-21swapper/223:59:112
29725040,0irq/27-eth0-tx-0-21swapper/223:46:072
29725040,0irq/27-eth0-tx-0-21swapper/223:08:432
29725040,0irq/27-eth0-tx-0-21swapper/222:59:322
29725040,0irq/27-eth0-tx-0-21swapper/222:50:312
29725040,0irq/27-eth0-tx-0-21swapper/222:35:192
29725040,0irq/27-eth0-tx-0-21swapper/221:54:452
29725040,0irq/27-eth0-tx-0-21swapper/221:13:372
29725040,0irq/27-eth0-tx-0-21swapper/220:59:452
29725040,0irq/27-eth0-tx-0-21swapper/220:59:452
29725040,0irq/27-eth0-tx-0-21swapper/200:08:372
29715040,0irq/26-eth0-rx-0-21swapper/323:59:243
29715040,0irq/26-eth0-rx-0-21swapper/322:59:023
29715040,0irq/26-eth0-rx-0-21swapper/322:48:273
29715040,0irq/26-eth0-rx-0-21swapper/321:33:393
29715040,0irq/26-eth0-rx-0-21swapper/320:18:363
29715040,0irq/26-eth0-rx-0-21swapper/320:13:433
259940,0migration/26183-21fschecks_time23:28:382
259940,0migration/229549-21munin-node19:03:372
259940,0migration/224658-21munin-node19:23:402
249940,0watchdog/231856-21if_eth1.321:43:392
249940,0watchdog/225927-21kthreadcore23:38:432
249940,0watchdog/222512-21aten_r1power_fr22:18:352
249940,0watchdog/215250-21df_abs21:33:392
249940,0watchdog/20-21swapper/222:23:392
249940,0watchdog/20-21swapper/222:13:512
249940,0watchdog/20-21swapper/221:38:392
179940,0migration/19538-21kthreadcore20:23:421
179940,0migration/13783-21kthreadcore20:43:431
179940,0migration/131784-21fschecks_count19:53:391
179940,0migration/129387-21taskset00:03:251
179940,0migration/127607-21kthreadcore19:48:421
179940,0migration/126458-21kthreadcore21:18:401
179940,0migration/126101-21kthreadcore23:18:431
179940,0migration/122769-21sh23:38:411
179940,0migration/118177-21taskset18:53:421
179940,0migration/116131-21kthreadcore23:33:411
179940,0migration/115695-21runrttasks21:13:401
179940,0migration/115595-21kthreadcore00:13:411
179940,0migration/115205-21kthreadcore19:38:431
169940,0watchdog/16640-21munin-node22:48:391
169940,0watchdog/15867-21ssh21:07:271
169940,0watchdog/15867-21ssh21:07:271
169940,0watchdog/13826-21ssh23:44:551
169940,0watchdog/130912-21tune2fs22:23:391
169940,0watchdog/122852-21munin-node18:58:361
169940,0watchdog/121564-21ssh21:35:271
169940,0watchdog/115673-21grep23:53:431
169940,0watchdog/113901-21ssh22:12:471
169940,0watchdog/10-21swapper/123:48:431
169940,0watchdog/10-21swapper/100:13:031
159849944,0cyclictest0-21swapper/219:38:412
159849943,0cyclictest7805-21awk21:28:382
159849943,0cyclictest675-21awk20:18:392
159849943,0cyclictest6565-21awk19:58:412
159849943,0cyclictest3556-21lldpd21:08:272
159849943,0cyclictest3556-21lldpd20:14:272
159849943,0cyclictest3556-21lldpd19:22:572
159849943,0cyclictest3514-21snmpd23:34:052
159849943,0cyclictest3514-21snmpd22:38:352
159849943,0cyclictest3514-21snmpd20:27:042
159849943,0cyclictest3241-21irqbalance23:23:332
159849943,0cyclictest3241-21irqbalance23:05:032
159849943,0cyclictest3241-21irqbalance21:04:242
159849943,0cyclictest3241-21irqbalance21:04:242
159849943,0cyclictest3241-21irqbalance19:43:342
159849943,0cyclictest3241-21irqbalance19:34:142
159849943,0cyclictest3241-21irqbalance19:31:142
159849943,0cyclictest3241-21irqbalance18:59:042
159849943,0cyclictest3241-21irqbalance18:56:342
159849943,0cyclictest32311-21awk19:53:412
159849943,0cyclictest30373-21awk00:03:402
159849943,0cyclictest27544-21awk20:38:402
159849943,0cyclictest23989-21awk21:18:382
159849943,0cyclictest22650-21awk23:18:402
159849943,0cyclictest19819-21awk20:08:402
159849943,0cyclictest1742-21awk20:43:412
159849943,0cyclictest14817-21awk22:53:382
159849943,0cyclictest14612-21awk23:13:392
159849943,0cyclictest14258-21awk20:28:402
159849943,0cyclictest14129-21sadc22:13:242
159849940,0cyclictest0-21swapper/222:43:282
159839944,0cyclictest0-21swapper/123:31:351
159839944,0cyclictest0-21swapper/122:45:331
159839944,0cyclictest0-21swapper/121:28:361
159839943,0cyclictest6720-21awk23:08:401
159839943,0cyclictest6531-21awk19:58:411
159839943,0cyclictest5562-21awk19:33:391
159839943,0cyclictest3556-21lldpd22:15:281
159839943,0cyclictest3556-21lldpd21:23:281
159839943,0cyclictest3556-21lldpd21:02:571
159839943,0cyclictest3556-21lldpd21:02:571
159839943,0cyclictest3556-21lldpd19:44:271
159839943,0cyclictest3556-21lldpd19:13:271
159839943,0cyclictest3556-21lldpd19:08:271
159839943,0cyclictest3556-21lldpd19:03:261
159839943,0cyclictest31380-21awk19:28:411
159839943,0cyclictest26589-21awk20:13:411
159839943,0cyclictest22874-21awk22:58:401
159839943,0cyclictest22270-21awk00:18:401
159839943,0cyclictest19960-21awk20:08:411
159839943,0cyclictest18004-21awk19:18:411
159829944,0cyclictest0-21swapper/023:20:020
159829944,0cyclictest0-21swapper/022:39:030
159829944,0cyclictest0-21swapper/021:00:400
159829944,0cyclictest0-21swapper/021:00:400
159829944,0cyclictest0-21swapper/000:14:450
159829943,0cyclictest6835-21awk22:48:400
159829943,0cyclictest4636-21awk19:08:400
159829943,0cyclictest3514-21snmpd22:10:500
159829943,0cyclictest3241-21irqbalance22:27:330
159829943,0cyclictest32287-21awk19:53:410
159829943,0cyclictest31751-21awk21:43:390
159829943,0cyclictest30652-21awk23:23:400
159829943,0cyclictest13916-21kworker/0:123:06:080
159829943,0cyclictest13916-21kworker/0:121:17:330
159829943,0cyclictest11420-21awk19:13:410
149940,0migration/023995-21kthreadcore20:33:440
8215030,0irq/24-0000:00:0-21swapper/220:48:292
8215030,0irq/24-0000:00:0-21swapper/220:33:292
8215030,0irq/24-0000:00:0-21swapper/219:09:102
29725030,0irq/27-eth0-tx-0-21swapper/020:03:370
29725030,0irq/27-eth0-tx-0-21swapper/019:23:370
29715030,0irq/26-eth0-rx-0-21swapper/320:41:473
29715030,0irq/26-eth0-rx-0-21swapper/320:08:363
29715030,0irq/26-eth0-rx-0-21swapper/319:58:483
29715030,0irq/26-eth0-rx-0-21swapper/319:13:423
259930,0migration/216006-21kthreadcore20:03:422
249930,0watchdog/20-21swapper/219:13:402
169930,0watchdog/1690-21munin-node20:18:401
169930,0watchdog/10-21swapper/121:48:431
169930,0watchdog/10-21swapper/120:53:351
159849932,0cyclictest31150-21munin-node21:23:382
159849932,0cyclictest25633-21awk19:48:412
159839932,0cyclictest3556-21lldpd20:03:271
159839932,0cyclictest27933-21sensors22:38:461
159839932,0cyclictest20916-21awk20:33:421
159839932,0cyclictest14892-21awk22:53:391
159839930,0cyclictest0-21swapper/120:41:131
159829933,0cyclictest13916-21kworker/0:123:58:280
159829933,0cyclictest13916-21kworker/0:121:58:360
159829933,0cyclictest13916-21kworker/0:121:48:260
159829933,0cyclictest13916-21kworker/0:121:33:270
159829933,0cyclictest13916-21kworker/0:119:59:050
159829933,0cyclictest13916-21kworker/0:119:28:310
159829932,0cyclictest1616-21sed20:43:400
159829930,0cyclictest22819-21munin-node18:58:370
29715020,0irq/26-eth0-rx-8933-21kthreadcore19:33:423
29715020,0irq/26-eth0-rx-0-21swapper/319:53:373
29715020,0irq/26-eth0-rx-0-21swapper/319:23:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional