You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 06:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2s.osadl.org (updated Tue Jul 14, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2841723930,0sleep20-21swapper/218:46:252
304450350,0irq/25-eth10-21swapper/318:44:583
2868323420,0sleep00-21swapper/018:49:310
2856123423,0sleep10-21swapper/118:48:081
339960,0migration/39265-21sh00:19:213
339960,0migration/33595-21fschecks_time21:55:073
339960,0migration/326776-21df_abs23:30:053
339960,0migration/326238-21sh22:07:523
339960,0migration/325997-21sh21:07:053
339960,0migration/325431-21sh23:07:113
339960,0migration/322983-21sshd19:09:073
339960,0migration/318296-21sh22:23:373
339960,0migration/317847-21sh23:24:083
339960,0migration/310192-21sh21:37:403
287839960,0cyclictest0-21swapper/121:34:041
287829960,0cyclictest28810-21runrttasks19:10:150
287829960,0cyclictest0-21swapper/022:12:490
149960,0migration/029232-21cpuspeed_turbos18:50:040
149960,0migration/010892-21sh21:19:110
149960,0migration/010046-21sh22:38:300
339950,0migration/3646-21runrttasks22:10:163
339950,0migration/35434-21irqrtprio19:20:103
339950,0migration/34856-21kthreadcore23:15:103
339950,0migration/3356-21runrttasks23:51:343
339950,0migration/332115-21kthreadcore18:50:103
339950,0migration/330503-21latency20:00:123
339950,0migration/329371-21taskset19:10:573
339950,0migration/328123-21fschecks_time21:30:073
339950,0migration/313014-21kthreadcore19:00:113
339950,0migration/311882-21fschecks_time21:40:063
339950,0migration/311882-21fschecks_time21:40:063
339950,0migration/311194-21irqcore23:40:093
339950,0migration/310679-21munin-node00:00:043
29725050,0irq/27-eth0-tx-3532-21ntpd23:15:132
29725050,0irq/27-eth0-tx-0-21swapper/020:49:550
29725050,0irq/27-eth0-tx-0-21swapper/020:45:130
29725050,0irq/27-eth0-tx-0-21swapper/020:10:130
29725050,0irq/27-eth0-tx-0-21swapper/019:40:060
29725050,0irq/27-eth0-tx-0-21swapper/019:39:350
29715050,0irq/26-eth0-rx-7320-21mdstat23:55:103
29715050,0irq/26-eth0-rx-6447-21cut22:15:103
29715050,0irq/26-eth0-rx-4482-21tr22:35:103
29715050,0irq/26-eth0-rx-27750-21diskstats21:50:063
29715050,0irq/26-eth0-rx-23815-21grep22:25:103
29715050,0irq/26-eth0-rx-18048-21chrt00:05:053
29715050,0irq/26-eth0-rx-12473-21kernelversion22:00:093
29715050,0irq/26-eth0-rx-10352-21kthreadcore20:35:113
29715050,0irq/26-eth0-rx-10103-21ssh22:59:173
29715050,0irq/26-eth0-rx-0-21swapper/323:10:223
29715050,0irq/26-eth0-rx-0-21swapper/322:59:523
29715050,0irq/26-eth0-rx-0-21swapper/321:24:533
29715050,0irq/26-eth0-rx-0-21swapper/321:19:383
29715050,0irq/26-eth0-rx-0-21swapper/321:10:033
29715050,0irq/26-eth0-rx-0-21swapper/321:00:153
29715050,0irq/26-eth0-rx-0-21swapper/320:55:073
287859950,0cyclictest0-21swapper/222:43:372
287859950,0cyclictest0-21swapper/222:33:322
287859950,0cyclictest0-21swapper/222:12:432
287859950,0cyclictest0-21swapper/221:20:222
287859950,0cyclictest0-21swapper/200:17:442
287839955,0cyclictest0-21swapper/123:20:581
287839955,0cyclictest0-21swapper/122:24:311
287839950,0cyclictest0-21swapper/123:55:481
287839950,0cyclictest0-21swapper/122:55:351
287829955,0cyclictest0-21swapper/023:28:100
287829955,0cyclictest0-21swapper/023:00:260
287829955,0cyclictest0-21swapper/000:04:070
287829954,0cyclictest12238-21awk21:40:080
287829954,0cyclictest12238-21awk21:40:080
287829950,0cyclictest0-21swapper/022:03:500
27150,0ktimersoftd/20-21swapper/200:08:132
249950,0watchdog/26223-21kthreadcore21:55:112
249950,0watchdog/217863-21chrt23:24:112
179950,0migration/19565-21taskset21:56:091
179950,0migration/131578-21kthreadcore19:15:101
179950,0migration/125297-21switchtime21:25:161
179950,0migration/12451-21latency_hist22:34:521
179950,0migration/119248-21missed_timers20:40:131
179950,0migration/111610-21fschecks_count22:00:061
169950,0watchdog/120116-21kthreadcore00:05:111
169950,0watchdog/10-21swapper/121:00:151
149950,0migration/09469-21taskset21:55:520
149950,0migration/07700-21timerwakeupswit00:15:160
149950,0migration/0705-21cpuspeed_turbos20:30:060
149950,0migration/04336-21aten_r1power_fr19:20:060
149950,0migration/04147-21idleruntime18:55:080
149950,0migration/04047-21kthreadcore23:55:080
149950,0migration/03221-21fschecks_count20:55:080
149950,0migration/031892-21taskset20:04:570
149950,0migration/031480-21kthreadcore21:10:090
149950,0migration/029571-21kthreadcore21:50:100
149950,0migration/028885-21kthreadcore23:50:100
149950,0migration/027108-21gltestperf23:30:060
149950,0migration/026538-21latency_hist23:09:520
149950,0migration/026282-21munin-node20:25:050
149950,0migration/02584-21aten_r1power_fr22:55:040
149950,0migration/025805-21fschecks_time20:00:070
149950,0migration/025649-21taskset22:26:470
149950,0migration/025496-21taskset21:45:270
149950,0migration/02469-21kthreadcore19:15:110
149950,0migration/021800-21kthreadcore22:45:100
149950,0migration/021286-21kthreadcore00:05:110
149950,0migration/020182-21kthreadcore19:30:120
149950,0migration/019931-21kernelversion23:05:100
149950,0migration/018572-21munin-node20:15:140
149950,0migration/018518-21latency_hist19:54:530
149950,0migration/01558-21taskset22:32:290
149950,0migration/01436-21sh21:30:550
149950,0migration/013878-21kthreadcore23:20:090
149950,0migration/012485-21kthreadcore23:40:100
149950,0migration/011684-21fschecks_time21:00:080
149950,0migration/010927-21taskset19:24:550
339940,0migration/38216-21kthreadcore18:55:123
339940,0migration/33954-21kthreadcore23:35:103
339940,0migration/33116-21kthreadcore20:05:113
339940,0migration/327162-21irqcore00:10:083
339940,0migration/322548-21kthreadcore19:30:123
339940,0migration/31894-21kthreadcore19:15:113
339940,0migration/316833-21kthreadcore20:40:113
339940,0migration/316378-21ntp_kernel_pll_22:40:143
29725040,0irq/27-eth0-tx-6067-21kthreadcore22:15:092
29725040,0irq/27-eth0-tx-27517-21fschecks_time22:50:062
29725040,0irq/27-eth0-tx-19608-21diskstats22:05:062
29725040,0irq/27-eth0-tx-13684-21kthreadcore22:20:092
29725040,0irq/27-eth0-tx-13220-21kthreadcore21:40:092
29725040,0irq/27-eth0-tx-13220-21kthreadcore21:40:092
29725040,0irq/27-eth0-tx-0-21swapper/223:50:092
29725040,0irq/27-eth0-tx-0-21swapper/223:48:152
29725040,0irq/27-eth0-tx-0-21swapper/223:30:372
29725040,0irq/27-eth0-tx-0-21swapper/223:10:122
29725040,0irq/27-eth0-tx-0-21swapper/223:05:092
29725040,0irq/27-eth0-tx-0-21swapper/222:28:282
29725040,0irq/27-eth0-tx-0-21swapper/222:00:052
29725040,0irq/27-eth0-tx-0-21swapper/221:50:072
29725040,0irq/27-eth0-tx-0-21swapper/200:00:092
29725040,0irq/27-eth0-tx-0-21swapper/020:24:420
29715040,0irq/26-eth0-rx-21124-21kthreadcore22:45:103
29715040,0irq/26-eth0-rx-0-21swapper/323:45:483
29715040,0irq/26-eth0-rx-0-21swapper/323:24:583
29715040,0irq/26-eth0-rx-0-21swapper/322:50:563
29715040,0irq/26-eth0-rx-0-21swapper/322:30:053
29715040,0irq/26-eth0-rx-0-21swapper/321:45:003
29715040,0irq/26-eth0-rx-0-21swapper/321:20:063
29715040,0irq/26-eth0-rx-0-21swapper/320:50:033
29715040,0irq/26-eth0-rx-0-21swapper/320:45:133
29715040,0irq/26-eth0-rx-0-21swapper/320:20:053
287859944,0cyclictest0-21swapper/222:35:162
287859944,0cyclictest0-21swapper/221:16:542
287859943,0cyclictest6116-21awk19:45:102
287859943,0cyclictest3556-21lldpd20:23:202
287859943,0cyclictest3556-21lldpd20:08:492
287859943,0cyclictest3556-21lldpd19:35:192
287859943,0cyclictest3556-21lldpd19:06:472
287859943,0cyclictest3514-21snmpd23:40:082
287859943,0cyclictest3514-21snmpd23:35:082
287859943,0cyclictest3514-21snmpd23:25:082
287859943,0cyclictest3514-21snmpd21:47:232
287859943,0cyclictest3514-21snmpd20:16:532
287859943,0cyclictest3514-21snmpd19:53:382
287859943,0cyclictest3514-21snmpd19:29:532
287859943,0cyclictest3514-21snmpd19:21:522
287859943,0cyclictest3514-21snmpd19:16:222
287859943,0cyclictest3514-21snmpd18:56:072
287859943,0cyclictest3241-21irqbalance22:55:112
287859943,0cyclictest3241-21irqbalance21:09:512
287859943,0cyclictest3241-21irqbalance20:50:212
287859943,0cyclictest3241-21irqbalance20:46:522
287859943,0cyclictest3241-21irqbalance20:41:022
287859943,0cyclictest3241-21irqbalance20:35:122
287859943,0cyclictest28489-21ps21:10:082
287859943,0cyclictest27201-21sadc21:29:532
287859943,0cyclictest2694-21awk23:55:062
287859943,0cyclictest19803-21awk22:45:082
287859943,0cyclictest11481-21awk23:00:082
287839944,0cyclictest0-21swapper/123:27:261
287839944,0cyclictest0-21swapper/123:11:211
287839943,0cyclictest3514-21snmpd20:35:231
287839943,0cyclictest3514-21snmpd19:30:081
287839943,0cyclictest3514-21snmpd19:13:071
287839943,0cyclictest342-21awk20:05:091
287839943,0cyclictest3241-21irqbalance22:45:511
287839943,0cyclictest3241-21irqbalance00:01:511
287839943,0cyclictest29952-21awk18:50:081
287839943,0cyclictest28322-21awk21:50:081
287839943,0cyclictest27770-21awk22:50:071
287839943,0cyclictest27364-21awk23:30:071
287839943,0cyclictest27178-21awk20:25:091
287839943,0cyclictest12429-21awk21:20:091
287839943,0cyclictest12147-21awk21:40:071
287839943,0cyclictest12147-21awk21:40:071
287829944,0cyclictest0-21swapper/000:11:410
287829943,0cyclictest3556-21lldpd21:25:200
287829943,0cyclictest3556-21lldpd21:21:200
287829943,0cyclictest3241-21irqbalance23:46:310
287829943,0cyclictest3241-21irqbalance22:42:510
287829943,0cyclictest3241-21irqbalance22:05:010
287829943,0cyclictest3241-21irqbalance21:05:110
287829943,0cyclictest30925-21kworker/0:121:35:000
259940,0migration/25038-21kthreadcore20:55:122
259940,0migration/230598-21kthreadcore00:10:102
259940,0migration/223197-21rt-features19:30:162
259940,0migration/210233-21cpuspeed_turbos19:00:062
249940,0watchdog/23698-21fschecks_count21:35:072
249940,0watchdog/228188-21perl21:30:072
249940,0watchdog/227142-21kthreadcore19:10:122
249940,0watchdog/226848-21grep20:25:072
249940,0watchdog/224166-21processes19:55:162
249940,0watchdog/20-21swapper/221:00:152
249940,0watchdog/20-21swapper/220:30:072
249940,0watchdog/20-21swapper/220:10:112
249940,0watchdog/20-21swapper/220:00:112
249940,0watchdog/20-21swapper/219:40:122
249940,0watchdog/20-21swapper/218:50:162
179940,0migration/18630-21kthreadcore19:45:121
179940,0migration/1543-21aten_r1power_fr20:30:051
179940,0migration/14091-21kthreadcore23:35:101
179940,0migration/13390-21kthreadcore00:15:091
179940,0migration/131940-21kthreadcore22:10:111
179940,0migration/131004-21kthreadcore00:10:101
179940,0migration/130516-21kthreadcore20:50:101
179940,0migration/129537-21kthreadcore20:00:111
179940,0migration/128122-21kthreadcore23:50:091
179940,0migration/126305-21kthreadcore19:35:121
179940,0migration/122432-21timerandwakeup19:05:171
179940,0migration/121306-21kthreadcore21:45:101
179940,0migration/119028-21munin-node22:25:031
179940,0migration/115311-21kthreadcore19:50:091
179940,0migration/114784-21kthreadcore23:40:111
179940,0migration/112512-21kthreadcore19:00:111
169940,0watchdog/123994-21kthreadcore22:05:111
169940,0watchdog/120345-21smartctl20:20:071
169940,0watchdog/118311-21ssh23:04:511
169940,0watchdog/11349-21kthreadcore19:40:121
169940,0watchdog/110206-21ssh22:18:271
169940,0watchdog/10-21swapper/122:40:111
169940,0watchdog/10-21swapper/122:35:071
169940,0watchdog/10-21swapper/121:05:111
169940,0watchdog/10-21swapper/119:55:161
169940,0watchdog/10-21swapper/119:25:121
169940,0watchdog/10-21swapper/119:20:081
169940,0watchdog/10-21swapper/118:55:121
149940,0migration/09843-21kthreadcore19:45:130
29725030,0irq/27-eth0-tx-0-21swapper/020:40:050
29715030,0irq/26-eth0-rx-0-21swapper/320:31:103
29715030,0irq/26-eth0-rx-0-21swapper/320:19:443
29715030,0irq/26-eth0-rx-0-21swapper/320:10:063
29715030,0irq/26-eth0-rx-0-21swapper/319:55:183
29715030,0irq/26-eth0-rx-0-21swapper/319:51:433
29715030,0irq/26-eth0-rx-0-21swapper/319:45:063
29715030,0irq/26-eth0-rx-0-21swapper/319:41:073
29715030,0irq/26-eth0-rx-0-21swapper/319:35:073
29715030,0irq/26-eth0-rx-0-21swapper/319:25:063
287839933,0cyclictest0-21swapper/123:47:551
287839932,0cyclictest9226-21cut20:10:111
287839932,0cyclictest3333-21sh21:15:041
287839932,0cyclictest3241-21irqbalance23:05:111
287839932,0cyclictest2870-21grep23:15:061
287839932,0cyclictest28449-21awk21:10:071
287839932,0cyclictest17469-21kthreadcore20:15:101
287829933,0cyclictest30925-21kworker/0:122:14:580
287829933,0cyclictest30925-21kworker/0:120:34:550
287829933,0cyclictest30925-21kworker/0:119:54:590
287829933,0cyclictest30925-21kworker/0:118:59:550
287829933,0cyclictest24763-21kworker/0:223:34:560
287829933,0cyclictest24763-21kworker/0:223:15:020
287829933,0cyclictest24763-21kworker/0:222:49:540
287829930,0cyclictest17062-21diskstats19:05:060
169930,0watchdog/13012-21cpuspeed_turbos20:55:071
169930,0watchdog/10-21swapper/121:34:551
149930,0migration/010966-21sh22:20:000
35120,0ktimersoftd/327969-21kthreadcore20:25:113
169920,0watchdog/10-21swapper/120:44:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional