You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 04:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Aug 15, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450470,0irq/25-eth10-21swapper/318:42:013
1120223623,0sleep10-21swapper/118:46:021
1115723531,0sleep20-21swapper/218:45:312
1097023430,0sleep00-21swapper/018:43:210
113469976,0cyclictest0-21swapper/122:27:071
35160,0ktimersoftd/30-21swapper/320:56:563
339960,0migration/326716-21sh23:57:243
339960,0migration/326252-21munin-node19:42:143
339960,0migration/317999-21munin-node21:12:043
29715060,0irq/26-eth0-rx-31322-21chrt22:00:273
29715060,0irq/26-eth0-rx-18157-21ntp_states23:52:093
29715060,0irq/26-eth0-rx-14985-21ps22:10:513
179960,0migration/132166-21sh21:19:191
149960,0migration/030987-21sh21:59:250
113479960,0cyclictest0-21swapper/220:27:092
113469960,0cyclictest5863-21aten_r1power_vo23:07:001
113459960,0cyclictest0-21swapper/023:27:560
4150,0ktimersoftd/09611-21diskmemload23:24:570
339950,0migration/38740-21idleruntime19:57:043
339950,0migration/38387-21runrttasks20:18:503
339950,0migration/37926-21runrttasks21:24:443
339950,0migration/36105-21diskmemload22:24:583
339950,0migration/329963-21if_eth023:42:053
339950,0migration/329640-21kthreadcore19:22:053
339950,0migration/327944-21aten_r1power_cu20:12:033
339950,0migration/326606-21irqrtprio21:17:053
339950,0migration/324181-21kthreadcore22:57:063
339950,0migration/323724-21munin-node18:52:133
339950,0migration/316241-21taskset21:09:023
339950,0migration/316075-21kthreadcore19:37:083
339950,0migration/315604-21munin-node22:12:013
339950,0migration/314899-21kthreadcore00:12:063
339950,0migration/313586-21latency_hist23:11:503
339950,0migration/312983-21latency_hist23:31:503
339950,0migration/312057-21fschecks_count18:47:023
339950,0migration/311801-21kthreadcore21:27:073
339950,0migration/311765-21sh23:50:093
339950,0migration/311711-21timerandwakeup19:07:113
29725050,0irq/27-eth0-tx-0-21swapper/019:26:180
29725050,0irq/27-eth0-tx-0-21swapper/019:18:270
29715050,0irq/26-eth0-rx-9437-21irqrtprio21:47:073
29715050,0irq/26-eth0-rx-8266-21irqrtprio22:27:063
29715050,0irq/26-eth0-rx-6960-21taskset21:43:453
29715050,0irq/26-eth0-rx-6559-21runrttasks23:22:043
29715050,0irq/26-eth0-rx-25376-21kthreadcore23:37:073
29715050,0irq/26-eth0-rx-24027-21irqrtprio22:37:063
29715050,0irq/26-eth0-rx-23519-21telnet22:17:003
29715050,0irq/26-eth0-rx-210952sleep322:54:093
29715050,0irq/26-eth0-rx-19112-21kthreadcore20:52:073
29715050,0irq/26-eth0-rx-0-21swapper/323:16:553
29715050,0irq/26-eth0-rx-0-21swapper/323:07:083
29715050,0irq/26-eth0-rx-0-21swapper/322:47:053
29715050,0irq/26-eth0-rx-0-21swapper/322:44:213
29715050,0irq/26-eth0-rx-0-21swapper/322:32:043
29715050,0irq/26-eth0-rx-0-21swapper/321:56:373
29715050,0irq/26-eth0-rx-0-21swapper/321:37:083
29715050,0irq/26-eth0-rx-0-21swapper/321:32:043
29715050,0irq/26-eth0-rx-0-21swapper/320:50:443
29715050,0irq/26-eth0-rx-0-21swapper/320:42:083
29715050,0irq/26-eth0-rx-0-21swapper/300:07:053
29715050,0irq/26-eth0-rx-0-21swapper/300:01:513
27150,0ktimersoftd/29611-21diskmemload20:56:562
249950,0watchdog/29017-21gltestperf21:47:042
19150,0ktimersoftd/10-21swapper/120:56:561
179950,0migration/19384-21taskset20:44:271
179950,0migration/18707-21kthreadcore19:07:051
179950,0migration/15246-21ntp_offset22:02:101
179950,0migration/11988-21kthreadcore23:22:071
179950,0migration/119016-21taskset00:15:061
179950,0migration/116708-21irqcore22:12:061
169950,0watchdog/19016-21cut21:47:041
169950,0watchdog/115663-21taskset21:07:161
149950,0migration/09180-21kthreadcore23:47:050
149950,0migration/08976-21gltestperf21:47:040
149950,0migration/08369-21fschecks_count19:57:030
149950,0migration/07969-21kthreadcore20:42:080
149950,0migration/06778-21latency_hist22:26:500
149950,0migration/05612-21sh22:45:260
149950,0migration/030639-21taskset22:20:200
149950,0migration/029945-21kthreadcore00:02:070
149950,0migration/029356-21kthreadcore18:57:080
149950,0migration/029356-21kthreadcore18:57:080
149950,0migration/02837-21kthreadcore19:27:070
149950,0migration/026848-21rt-features23:37:110
149950,0migration/025928-21kthreadcore23:17:060
149950,0migration/02563-21kthreadcore19:52:070
149950,0migration/02451-21kthreadcore21:22:060
149950,0migration/023284-21irqcore20:32:060
149950,0migration/021458-21kthreadcore21:12:080
149950,0migration/021341-21aten_r1power_po20:06:590
149950,0migration/020821-21kthreadcore20:52:080
149950,0migration/017287-21latency_hist21:11:500
149950,0migration/017184-21kthreadcore22:32:040
149950,0migration/015512-21proc_pri20:47:110
149950,0migration/015225-21taskset22:11:350
149950,0migration/014633-21kthreadcore23:52:060
149950,0migration/014519-21munin-node23:12:040
149950,0migration/01171-21smart_sdb20:12:140
113469955,0cyclictest0-21swapper/123:57:461
113469955,0cyclictest0-21swapper/123:53:031
113469950,0cyclictest0-21swapper/123:41:041
113469950,0cyclictest0-21swapper/121:44:051
113459955,0cyclictest9611-21diskmemload21:37:060
113459950,0cyclictest0-21swapper/023:05:520
339940,0migration/34751-21kthreadcore19:52:083
339940,0migration/313466-21kthreadcore20:22:073
29725040,0irq/27-eth0-tx-9611-21diskmemload22:46:562
29725040,0irq/27-eth0-tx-8868-21ssh21:26:552
29725040,0irq/27-eth0-tx-27757-21ssh23:38:432
29725040,0irq/27-eth0-tx-25359-21tr23:17:062
29725040,0irq/27-eth0-tx-0-21swapper/221:37:022
29725040,0irq/27-eth0-tx-0-21swapper/221:12:072
29725040,0irq/27-eth0-tx-0-21swapper/221:02:092
29725040,0irq/27-eth0-tx-0-21swapper/020:27:050
29725040,0irq/27-eth0-tx-0-21swapper/019:32:050
29725040,0irq/27-eth0-tx-0-21swapper/019:01:560
29715040,0irq/26-eth0-rx-0-21swapper/323:32:003
29715040,0irq/26-eth0-rx-0-21swapper/323:04:373
29715040,0irq/26-eth0-rx-0-21swapper/322:02:293
29715040,0irq/26-eth0-rx-0-21swapper/321:02:173
29715040,0irq/26-eth0-rx-0-21swapper/319:27:013
29715040,0irq/26-eth0-rx-0-21swapper/319:17:083
259940,0migration/25220-21kthreadcore20:42:072
259940,0migration/231639-21kthreadcore23:22:062
259940,0migration/231102-21if_eth023:02:032
259940,0migration/219853-21munin-node22:52:072
259940,0migration/215950-21kthreadcore23:12:072
249940,0watchdog/26364-21grep21:42:122
249940,0watchdog/25142-21ssh22:44:002
249940,0watchdog/24084-21aten_r1power_fr00:07:002
249940,0watchdog/229730-21taskset22:17:322
249940,0watchdog/229190-21gltestperf00:02:042
249940,0watchdog/220027-21kthreadcore21:32:082
249940,0watchdog/21531-21kthreadcore22:22:042
249940,0watchdog/20-21swapper/223:57:122
249940,0watchdog/20-21swapper/222:57:082
249940,0watchdog/20-21swapper/220:53:362
249940,0watchdog/20-21swapper/220:32:042
249940,0watchdog/20-21swapper/220:02:052
249940,0watchdog/20-21swapper/219:02:092
249940,0watchdog/20-21swapper/218:47:012
179940,0migration/17991-21diskmemload22:47:051
179940,0migration/17206-21kthreadcore23:27:061
179940,0migration/16272-21kthreadcore21:02:061
179940,0migration/15361-21runrttasks19:03:491
179940,0migration/12719-21taskset20:39:591
179940,0migration/126061-21kthreadcore21:57:051
179940,0migration/124976-21munin-node21:37:031
179940,0migration/124700-21taskset20:54:351
179940,0migration/124675-21kthreadcore20:32:071
179940,0migration/12333-21irqcore19:52:061
179940,0migration/122737-21latency_hist22:36:501
179940,0migration/122649-21sh23:17:051
179940,0migration/118842-21kthreadcore20:02:071
179940,0migration/117813-21kthreadcore23:12:081
179940,0migration/114526-21kthreadcore19:12:061
179940,0migration/113340-21kthreadcore20:47:071
179940,0migration/112207-21kthreadcore22:07:071
179940,0migration/110667-21kthreadcore20:22:061
169940,0watchdog/14083-21aten_r1power_fr00:07:001
169940,0watchdog/129189-21grep00:02:041
169940,0watchdog/127742-21grep22:57:081
169940,0watchdog/121248-21kthreadcore21:12:081
169940,0watchdog/119744-21kthreadcore18:52:091
169940,0watchdog/118830-21processes23:32:081
169940,0watchdog/116249-21ssh21:30:521
169940,0watchdog/115828-21kthreadcore22:52:041
169940,0watchdog/10-21swapper/119:37:091
169940,0watchdog/10-21swapper/119:32:011
169940,0watchdog/10-21swapper/119:27:051
149940,0migration/03639-21kthreadcore21:42:060
149940,0migration/017045-21kthreadcore19:12:070
149940,0migration/015438-21kthreadcore19:37:080
149940,0migration/013765-21sh22:29:020
149940,0migration/011002-21kthreadcore22:47:060
113479944,0cyclictest0-21swapper/222:37:032
113479943,0cyclictest8581-21awk22:07:052
113479943,0cyclictest595-21awk22:02:052
113479943,0cyclictest3556-21lldpd23:47:592
113479943,0cyclictest3514-21snmpd23:07:512
113479943,0cyclictest3514-21snmpd22:33:062
113479943,0cyclictest3514-21snmpd22:27:512
113479943,0cyclictest3514-21snmpd21:08:062
113479943,0cyclictest3514-21snmpd20:46:512
113479943,0cyclictest3514-21snmpd20:40:362
113479943,0cyclictest3514-21snmpd19:52:512
113479943,0cyclictest3514-21snmpd19:38:212
113479943,0cyclictest3514-21snmpd19:34:512
113479943,0cyclictest3514-21snmpd19:22:362
113479943,0cyclictest3241-21irqbalance23:51:582
113479943,0cyclictest3241-21irqbalance23:26:582
113479943,0cyclictest3241-21irqbalance21:55:182
113479943,0cyclictest3241-21irqbalance21:22:182
113479943,0cyclictest29898-21awk23:42:042
113479943,0cyclictest25030-21awk21:57:042
113479943,0cyclictest22074-21awk20:07:022
113479943,0cyclictest21237-21awk19:42:062
113479943,0cyclictest20217-21awk19:17:052
113479943,0cyclictest19164-21awk18:52:072
113479943,0cyclictest16444-21awk22:12:052
113479943,0cyclictest15098-21cat19:12:062
113479943,0cyclictest12903-21awk00:12:042
113479940,0cyclictest13166-21munin-node23:32:022
113479940,0cyclictest0-21swapper/221:16:582
113469944,0cyclictest0-21swapper/123:03:231
113469944,0cyclictest0-21swapper/122:17:211
113469943,0cyclictest3556-21lldpd22:35:281
113469943,0cyclictest3556-21lldpd21:52:581
113469943,0cyclictest3556-21lldpd20:21:261
113469943,0cyclictest3556-21lldpd18:58:561
113469943,0cyclictest3556-21lldpd18:58:561
113469943,0cyclictest3514-21snmpd20:28:211
113469943,0cyclictest3514-21snmpd20:12:361
113469943,0cyclictest3514-21snmpd20:00:511
113469943,0cyclictest3241-21irqbalance23:46:581
113469943,0cyclictest3241-21irqbalance23:42:581
113469943,0cyclictest32381-21ntpq19:47:101
113469943,0cyclictest32261-21awk22:22:021
113469943,0cyclictest22144-21awk20:07:031
113469943,0cyclictest1812-21awk21:22:041
113459944,0cyclictest0-21swapper/022:36:510
113459944,0cyclictest0-21swapper/021:32:220
113459944,0cyclictest0-21swapper/021:27:390
113459943,0cyclictest3514-21snmpd23:44:520
113459943,0cyclictest29781-21awk20:37:060
113459943,0cyclictest26719-21awk20:57:040
113459943,0cyclictest26353-21awk21:17:050
113459943,0cyclictest21001-21sadc20:06:500
113459943,0cyclictest14036-21awk23:32:010
113459943,0cyclictest12535-21awk18:47:040
339930,0migration/315935-21kthreadcore20:02:063
29715030,0irq/26-eth0-rx-0-21swapper/320:37:023
29715030,0irq/26-eth0-rx-0-21swapper/320:34:353
29715030,0irq/26-eth0-rx-0-21swapper/320:27:473
29715030,0irq/26-eth0-rx-0-21swapper/320:07:003
29715030,0irq/26-eth0-rx-0-21swapper/319:12:003
29715030,0irq/26-eth0-rx-0-21swapper/319:02:033
259930,0migration/229282-21kthreadcore20:12:092
249930,0watchdog/20-21swapper/220:22:042
169930,0watchdog/10-21swapper/122:42:121
169930,0watchdog/10-21swapper/119:22:051
169930,0watchdog/10-21swapper/118:47:051
113479933,0cyclictest3556-21lldpd19:47:262
113479932,0cyclictest984-21awk19:27:042
113479932,0cyclictest7484-21ls20:17:082
113479932,0cyclictest6856-21awk19:07:042
113479932,0cyclictest3514-21snmpd19:57:362
113479932,0cyclictest25756-21awk18:57:052
113479932,0cyclictest25756-21awk18:57:052
113469933,0cyclictest3556-21lldpd21:31:571
113469933,0cyclictest3556-21lldpd19:17:261
113469932,0cyclictest20266-21awk19:41:501
113459933,0cyclictest5647-21kworker/0:023:57:390
113459933,0cyclictest5647-21kworker/0:023:07:290
113459933,0cyclictest5647-21kworker/0:022:12:270
113459933,0cyclictest5647-21kworker/0:022:02:050
113459933,0cyclictest5647-21kworker/0:021:51:530
113459933,0cyclictest5647-21kworker/0:020:22:000
113459933,0cyclictest5647-21kworker/0:020:16:520
113459933,0cyclictest5647-21kworker/0:019:46:560
113459933,0cyclictest5647-21kworker/0:019:41:580
113459933,0cyclictest5647-21kworker/0:019:06:540
113459933,0cyclictest5647-21kworker/0:018:51:540
113459933,0cyclictest5647-21kworker/0:000:11:550
113459933,0cyclictest5647-21kworker/0:000:07:190
113459933,0cyclictest2359-21awk21:02:030
113459932,0cyclictest23202-21awk22:57:040
113459932,0cyclictest15279-21awk22:52:020
339920,0migration/37303-21diskstats19:32:023
29715020,0irq/26-eth0-rx-0-21swapper/319:46:553
29715020,0irq/26-eth0-rx-0-21swapper/318:57:013
29715020,0irq/26-eth0-rx-0-21swapper/318:57:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional