You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 03:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Aug 25, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
367228180,0sleep30-21swapper/318:44:443
357525554,0sleep20-21swapper/218:43:352
335523423,0sleep00-21swapper/018:41:210
370822824,0sleep10-21swapper/118:45:101
38499976,0cyclictest18176-21munin-run19:20:531
29715070,0irq/26-eth0-rx-6559-21runrttasks00:06:303
38519960,0cyclictest0-21swapper/221:34:072
38499960,0cyclictest0-21swapper/119:06:041
38489960,0cyclictest0-21swapper/023:02:250
339960,0migration/3927-21fschecks_time19:56:073
339960,0migration/39175-21sh20:48:303
339960,0migration/36870-21sh22:49:013
339960,0migration/34073-21munin-node19:06:143
339960,0migration/331543-21idleruntime-cro19:30:533
339960,0migration/325940-21sh21:20:283
339960,0migration/324786-21munin-node19:01:123
339960,0migration/323688-21sh23:46:283
339960,0migration/322825-21timerwakeupswit22:16:163
339960,0migration/316445-21sh21:53:593
339960,0migration/315681-21munin-node20:31:073
29715060,0irq/26-eth0-rx-13741-21cut18:51:113
29715060,0irq/26-eth0-rx-0-21swapper/322:23:413
19160,0ktimersoftd/10-21swapper/122:13:501
149960,0migration/08888-21irqcore22:51:090
149960,0migration/032696-21sh22:26:010
149960,0migration/029517-21kthreadcore20:41:090
149960,0migration/02591-21cpuspeed_turbos20:46:050
149960,0migration/023667-21sh22:40:050
38519950,0cyclictest0-21swapper/222:01:052
38519950,0cyclictest0-21swapper/200:11:182
38499955,0cyclictest0-21swapper/123:53:001
38499955,0cyclictest0-21swapper/122:36:041
38499955,0cyclictest0-21swapper/122:33:041
38499955,0cyclictest0-21swapper/122:27:051
38499955,0cyclictest0-21swapper/121:35:221
38499955,0cyclictest0-21swapper/121:25:071
38499955,0cyclictest0-21swapper/120:59:161
38499955,0cyclictest0-21swapper/120:41:081
38499954,0cyclictest3556-21lldpd21:56:031
38499954,0cyclictest3514-21snmpd23:31:231
38499954,0cyclictest14808-21sed20:06:101
38499950,0cyclictest0-21swapper/121:51:361
339950,0migration/39921-21kthreadcore20:01:113
339950,0migration/38104-21taskset22:09:183
339950,0migration/36496-21munin-node22:26:153
339950,0migration/35820-21kthreadcore18:46:103
339950,0migration/35145-21kthreadcore00:01:113
339950,0migration/3472-21taskset21:44:073
339950,0migration/332376-21switchtime21:01:123
339950,0migration/328345-21kthreadcore23:31:053
339950,0migration/324763-21munin-node22:41:063
339950,0migration/323387-21missed_timers21:36:123
339950,0migration/321548-21munin-node20:36:053
339950,0migration/318994-21fschecks_time19:21:073
339950,0migration/317175-21taskset21:34:313
339950,0migration/31638-21latency_hist21:25:533
29725050,0irq/27-eth0-tx-6559-21runrttasks18:56:160
29725050,0irq/27-eth0-tx-16836-21munin-node22:16:082
29725050,0irq/27-eth0-tx-16468-21idleruntime22:56:062
29725050,0irq/27-eth0-tx-14776-21munin-node20:31:050
29725050,0irq/27-eth0-tx-10773-21munin-node18:51:110
29725050,0irq/27-eth0-tx-0-21swapper/019:05:310
29715050,0irq/26-eth0-rx-9798-21kthreadcore22:31:103
29715050,0irq/26-eth0-rx-29290-21ssh23:56:053
29715050,0irq/26-eth0-rx-24288-21ls00:11:143
29715050,0irq/26-eth0-rx-1871-21munin-node21:26:083
29715050,0irq/26-eth0-rx-17021-21ssh20:52:493
29715050,0irq/26-eth0-rx-16907-21kthreadcore20:06:113
29715050,0irq/26-eth0-rx-14488-21chrt22:53:103
29715050,0irq/26-eth0-rx-0-21swapper/323:36:013
29715050,0irq/26-eth0-rx-0-21swapper/323:06:583
29715050,0irq/26-eth0-rx-0-21swapper/322:58:183
29715050,0irq/26-eth0-rx-0-21swapper/322:03:363
29715050,0irq/26-eth0-rx-0-21swapper/320:26:043
259950,0migration/26369-21kthreadcore21:26:092
259950,0migration/25789-21kthreadcore23:36:082
259950,0migration/226601-21latency_hist23:30:532
259950,0migration/223194-21timerandwakeup18:56:162
249950,0watchdog/216862-21kthreadcore23:16:112
179950,0migration/18122-21sh23:11:221
179950,0migration/17903-210anacron23:36:531
179950,0migration/15907-21munin-node22:46:161
179950,0migration/132195-21sh21:41:501
179950,0migration/122184-21sh22:57:231
179950,0migration/118559-21cpu21:16:051
179950,0migration/111586-21munin-node19:36:131
179950,0migration/111249-21idleruntime21:11:071
169950,0watchdog/118621-21perl21:36:071
169950,0watchdog/117907-21forks23:46:061
149950,0migration/09986-21fschecks_count23:41:080
149950,0migration/07738-21fschecks_time20:01:070
149950,0migration/05042-21kthreadcore22:06:100
149950,0migration/032628-21sh23:32:590
149950,0migration/032181-21taskset21:41:480
149950,0migration/031679-21taskset22:45:240
149950,0migration/02804-21fschecks_count21:06:080
149950,0migration/027932-21kthreadcore21:01:070
149950,0migration/026220-21sh21:00:440
149950,0migration/025729-21sh21:19:500
149950,0migration/025049-21taskset23:26:360
149950,0migration/024787-21aten_r1power_cu22:21:030
149950,0migration/024371-21timerandwakeup00:11:140
149950,0migration/022054-21sh23:18:520
149950,0migration/018975-21kthreadcore23:46:110
149950,0migration/018316-21latency_hist19:20:530
149950,0migration/016046-21pmu-power21:11:130
149950,0migration/014308-21kthreadcore19:16:110
149950,0migration/011217-21fschecks_time00:06:060
149950,0migration/010003-21kthreadcore20:26:100
38519944,0cyclictest0-21swapper/221:03:322
38519943,0cyclictest6043-21awk19:11:092
38519943,0cyclictest3556-21lldpd22:41:022
38519943,0cyclictest3556-21lldpd20:46:022
38519943,0cyclictest3556-21lldpd20:35:022
38519943,0cyclictest3514-21snmpd20:43:222
38519943,0cyclictest3514-21snmpd20:22:522
38519943,0cyclictest3514-21snmpd19:42:072
38519943,0cyclictest3241-21irqbalance21:21:312
38519943,0cyclictest3241-21irqbalance20:56:012
38519943,0cyclictest3241-21irqbalance19:16:022
38519943,0cyclictest3241-21irqbalance18:46:322
38519943,0cyclictest31615-21awk19:06:072
38519943,0cyclictest27260-21cut20:16:052
38519943,0cyclictest25988-21awk19:26:082
38519943,0cyclictest21472-21awk20:11:092
38519943,0cyclictest20324-21awk19:46:082
38519943,0cyclictest19334-21awk19:21:092
38499944,0cyclictest0-21swapper/123:09:011
38499944,0cyclictest0-21swapper/122:42:031
38499944,0cyclictest0-21swapper/121:49:431
38499944,0cyclictest0-21swapper/120:36:521
38499943,0cyclictest3556-21lldpd22:20:021
38499943,0cyclictest3514-21snmpd23:44:081
38499943,0cyclictest3514-21snmpd23:28:081
38499943,0cyclictest3514-21snmpd19:26:221
38499943,0cyclictest3211-21awk21:06:091
38499943,0cyclictest28057-21awk20:16:081
38499943,0cyclictest25014-21awk19:01:131
38499943,0cyclictest19377-21awk00:11:061
38489944,0cyclictest2092-21diskmemload23:55:420
38489944,0cyclictest0-21swapper/023:58:420
38489944,0cyclictest0-21swapper/022:01:050
38489944,0cyclictest0-21swapper/019:51:200
38489943,0cyclictest5036-21if_eth1.318:46:080
38489943,0cyclictest3514-21snmpd23:24:530
38489943,0cyclictest3514-21snmpd22:17:530
38489943,0cyclictest2312-21awk21:46:060
38489943,0cyclictest2298-21awk20:21:090
38489943,0cyclictest18837-21awk21:36:090
38489943,0cyclictest16525-21awk22:56:060
38489943,0cyclictest11259-21awk20:51:100
38489940,0cyclictest12214-40yum-updatesd-he19:36:480
38489940,0cyclictest0-21swapper/023:10:180
339940,0migration/39855-21kthreadcore23:11:243
339940,0migration/3952-21runrttasks20:18:573
339940,0migration/327576-21kthreadcore19:51:113
339940,0migration/324315-21kthreadcore19:46:113
29725040,0irq/27-eth0-tx-7147-21ssh22:06:262
29725040,0irq/27-eth0-tx-5155-21telnet19:11:050
29725040,0irq/27-eth0-tx-32107-21ssh22:46:002
29725040,0irq/27-eth0-tx-2500-21munin-node00:01:182
29725040,0irq/27-eth0-tx-24204-21python21:16:162
29725040,0irq/27-eth0-tx-22945-21ssh23:20:552
29725040,0irq/27-eth0-tx-2092-21diskmemload21:05:582
29725040,0irq/27-eth0-tx-17040-21hddtemp_smartct22:36:072
29725040,0irq/27-eth0-tx-14116-21ssh22:52:012
29725040,0irq/27-eth0-tx-0-21swapper/223:50:592
29725040,0irq/27-eth0-tx-0-21swapper/223:46:242
29725040,0irq/27-eth0-tx-0-21swapper/223:40:552
29725040,0irq/27-eth0-tx-0-21swapper/223:10:592
29725040,0irq/27-eth0-tx-0-21swapper/223:06:052
29725040,0irq/27-eth0-tx-0-21swapper/222:30:592
29725040,0irq/27-eth0-tx-0-21swapper/222:25:552
29725040,0irq/27-eth0-tx-0-21swapper/221:56:002
29725040,0irq/27-eth0-tx-0-21swapper/221:51:562
29725040,0irq/27-eth0-tx-0-21swapper/221:46:112
29725040,0irq/27-eth0-tx-0-21swapper/221:43:092
29725040,0irq/27-eth0-tx-0-21swapper/221:35:572
29725040,0irq/27-eth0-tx-0-21swapper/221:11:052
29725040,0irq/27-eth0-tx-0-21swapper/220:51:452
29725040,0irq/27-eth0-tx-0-21swapper/020:36:060
29725040,0irq/27-eth0-tx-0-21swapper/019:33:010
29715040,0irq/26-eth0-rx-6559-21runrttasks19:36:353
29715040,0irq/26-eth0-rx-20485-21kthreadcore18:56:123
29715040,0irq/26-eth0-rx-0-21swapper/323:51:453
29715040,0irq/26-eth0-rx-0-21swapper/323:41:223
29715040,0irq/26-eth0-rx-0-21swapper/323:30:123
29715040,0irq/26-eth0-rx-0-21swapper/323:21:133
29715040,0irq/26-eth0-rx-0-21swapper/323:16:113
29715040,0irq/26-eth0-rx-0-21swapper/323:00:583
29715040,0irq/26-eth0-rx-0-21swapper/322:38:573
29715040,0irq/26-eth0-rx-0-21swapper/322:11:063
29715040,0irq/26-eth0-rx-0-21swapper/321:56:103
29715040,0irq/26-eth0-rx-0-21swapper/321:47:263
29715040,0irq/26-eth0-rx-0-21swapper/321:11:023
29715040,0irq/26-eth0-rx-0-21swapper/321:05:593
29715040,0irq/26-eth0-rx-0-21swapper/320:56:243
29715040,0irq/26-eth0-rx-0-21swapper/320:41:103
29715040,0irq/26-eth0-rx-0-21swapper/320:21:043
29715040,0irq/26-eth0-rx-0-21swapper/319:41:123
29715040,0irq/26-eth0-rx-0-21swapper/319:11:393
259940,0migration/29825-21if_eth022:11:062
259940,0migration/26182-21aten_r1power_po19:36:052
259940,0migration/2326-21munin-node23:56:072
259940,0migration/224908-21taskset23:26:102
259940,0migration/224823-21sh19:01:122
259940,0migration/216233-21kthreadcore20:06:112
259940,0migration/211771-21taskset18:51:102
249940,0watchdog/229073-21needreboot23:01:112
249940,0watchdog/227096-21python20:36:152
249940,0watchdog/214892-21kthreadcore00:06:102
249940,0watchdog/211322-21kthreadcore20:01:112
249940,0watchdog/20-21swapper/222:20:592
179940,0migration/17504-21kthreadcore19:11:101
179940,0migration/17207-21kthreadcore00:01:121
179940,0migration/132233-21fschecks_count19:31:091
179940,0migration/130583-21kthreadcore23:56:061
179940,0migration/12901-21fschecks_count20:46:061
179940,0migration/127245-21gltestperf21:01:041
179940,0migration/127205-21kthreadcore23:01:091
179940,0migration/124836-21aten2.4-expect22:21:031
179940,0migration/123213-21kthreadcore19:46:111
179940,0migration/120509-21aten_r1power_cu20:11:041
179940,0migration/11914-21kthreadcore19:56:101
179940,0migration/113433-21fschecks_time19:41:071
179940,0migration/113171-21taskset20:01:281
179940,0migration/113012-21kthreadcore00:06:101
169940,0watchdog/125271-21ssh22:00:591
169940,0watchdog/116863-21kthreadcore23:16:111
169940,0watchdog/111302-21kthreadcore22:51:111
169940,0watchdog/10-21swapper/123:22:071
169940,0watchdog/10-21swapper/122:09:151
169940,0watchdog/10-21swapper/118:56:121
149940,0migration/09755-21kthreadcore22:31:100
149940,0migration/09266-21kthreadcore23:11:240
149940,0migration/028237-21kthreadcore19:26:100
149940,0migration/02098-21cpu21:26:030
149940,0migration/017936-21kthreadcore19:41:120
149940,0migration/013223-21kthreadcore21:51:110
149940,0migration/012688-21kthreadcore21:31:100
38519932,0cyclictest3514-21snmpd19:32:522
38519932,0cyclictest1244-21awk19:56:082
38499932,0cyclictest9775-21sensors18:46:141
38499932,0cyclictest7005-21processes20:21:141
38499932,0cyclictest3514-21snmpd20:28:521
38499931,0cyclictest12583-21cut20:51:121
38499930,0cyclictest0-21swapper/119:50:531
38489933,0cyclictest19989-21kworker/0:021:21:160
38489933,0cyclictest19989-21kworker/0:020:16:040
38489933,0cyclictest19989-21kworker/0:000:01:080
38489933,0cyclictest0-21swapper/022:46:110
38489933,0cyclictest0-21swapper/019:46:060
38489932,0cyclictest31576-21awk19:06:070
38489932,0cyclictest2415-21awk23:36:050
38489932,0cyclictest21330-21awk20:11:080
38489932,0cyclictest14666-21awk20:06:090
38489931,0cyclictest14840-21cat22:11:140
38489931,0cyclictest0-21swapper/021:56:160
38489930,0cyclictest0-21swapper/019:56:100
29715030,0irq/26-eth0-rx-0-21swapper/320:11:233
29715030,0irq/26-eth0-rx-0-21swapper/319:30:543
249930,0watchdog/20-21swapper/220:25:592
249930,0watchdog/20-21swapper/219:51:112
19130,0ktimersoftd/10-21swapper/120:31:021
179930,0migration/122574-21kthreadcore19:21:111
179930,0migration/11911-21aten_r1power_en21:26:021
169930,0watchdog/10-21swapper/118:51:121
29715020,0irq/26-eth0-rx-0-21swapper/319:16:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional