You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 04:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Mon Aug 31, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1795924637,0sleep10-21swapper/118:41:131
1802924240,0sleep00-21swapper/018:42:000
304450350,0irq/25-eth10-21swapper/318:40:363
1196422622,0sleep20-21swapper/218:40:262
183829988,0cyclictest0-21swapper/020:46:570
183829976,0cyclictest0-21swapper/021:50:360
339960,0migration/37007-21sh21:17:573
339960,0migration/332663-21sh19:40:383
339960,0migration/330017-21sh21:52:243
339960,0migration/324124-21sh20:49:243
339960,0migration/323015-21sh21:06:353
339960,0migration/322135-21sh21:47:363
339960,0migration/321739-21smart_sda21:25:413
339960,0migration/321699-21munin-node23:10:333
339960,0migration/315430-21sh21:02:583
339960,0migration/313265-21sh22:23:243
29715060,0irq/26-eth0-rx-6559-21runrttasks00:11:133
29715060,0irq/26-eth0-rx-27069-21cut22:30:373
29715060,0irq/26-eth0-rx-17955-21ntp_kernel_err23:25:373
259960,0migration/220329-21sh19:35:192
259960,0migration/215122-21sh21:23:392
19160,0ktimersoftd/116580-21diskmemload22:53:091
183859966,0cyclictest14783-21sensors20:15:392
183829960,0cyclictest27259-21sh23:32:550
149960,0migration/032070-21cpuspeed_turbos21:35:290
149960,0migration/021407-21unixbench_multi21:45:420
149960,0migration/010771-21kthreadcore21:40:370
8215050,0irq/24-0000:00:24262-21munin-plugin-st21:10:182
339950,0migration/35791-21kthreadcore20:35:343
339950,0migration/35785-21taskset18:57:573
339950,0migration/35603-21munin-node22:40:293
339950,0migration/34735-21kthreadcore20:10:343
339950,0migration/33474-21taskset23:18:093
339950,0migration/328629-21fschecks_count20:05:333
339950,0migration/326638-21kthreadcore21:30:353
339950,0migration/326041-21kthreadcore20:00:363
339950,0migration/324880-21runrttasks19:10:373
339950,0migration/324283-21munin-node18:45:413
339950,0migration/323294-21kthreadcore23:30:363
339950,0migration/321107-21sh22:06:193
339950,0migration/32109-21kthreadcore22:35:353
339950,0migration/320396-21runrttasks22:47:333
339950,0migration/319881-21aten_r1power_cu23:50:303
339950,0migration/31885-21timerwakeupswit23:35:443
339950,0migration/31791-21taskset23:56:253
339950,0migration/317378-21munin-node00:05:433
339950,0migration/315369-21taskset20:18:223
339950,0migration/314619-21taskset21:43:483
339950,0migration/314527-21taskset19:54:243
339950,0migration/31125-21fschecks_time19:20:323
339950,0migration/310916-21taskset00:04:413
29725050,0irq/27-eth0-tx-3363-21munin-node20:35:310
29725050,0irq/27-eth0-tx-31287-21ssh21:34:322
29725050,0irq/27-eth0-tx-25793-21munin-node20:50:352
29725050,0irq/27-eth0-tx-20368-21munin-node23:30:332
29725050,0irq/27-eth0-tx-18593-21munin-node18:45:420
29725050,0irq/27-eth0-tx-18141-21cut21:25:362
29725050,0irq/27-eth0-tx-11660-21ssh23:23:452
29725050,0irq/27-eth0-tx-0-21swapper/223:06:022
29725050,0irq/27-eth0-tx-0-21swapper/222:33:092
29725050,0irq/27-eth0-tx-0-21swapper/222:02:342
29725050,0irq/27-eth0-tx-0-21swapper/019:15:350
29725050,0irq/27-eth0-tx-0-21swapper/019:15:350
29715050,0irq/26-eth0-rx-6848-21munin-node22:00:393
29715050,0irq/26-eth0-rx-6559-21runrttasks23:01:533
29715050,0irq/26-eth0-rx-4076-21kthreadcore20:55:383
29715050,0irq/26-eth0-rx-0-21swapper/323:45:303
29715050,0irq/26-eth0-rx-0-21swapper/323:40:373
29715050,0irq/26-eth0-rx-0-21swapper/322:57:243
29715050,0irq/26-eth0-rx-0-21swapper/322:13:033
29715050,0irq/26-eth0-rx-0-21swapper/321:56:543
29715050,0irq/26-eth0-rx-0-21swapper/321:20:333
29715050,0irq/26-eth0-rx-0-21swapper/321:10:323
259950,0migration/2960-21latency20:05:382
259950,0migration/24592-21kthreadcore21:15:362
259950,0migration/232633-21latency_hist20:55:182
259950,0migration/23120-21munin-node22:55:432
259950,0migration/227386-21unixbench-2d20:00:412
259950,0migration/224922-21kthreadcore23:50:372
259950,0migration/224348-21kthreadcore22:10:362
259950,0migration/223397-21kthreadcore23:10:362
259950,0migration/214173-21aten_r1power_cu22:25:292
259950,0migration/212543-21aten_r1power_po23:25:292
259950,0migration/211324-21sh23:44:242
249950,0watchdog/211063-21memory22:40:362
183859955,0cyclictest0-21swapper/222:47:352
183859955,0cyclictest0-21swapper/221:45:282
183859955,0cyclictest0-21swapper/221:02:072
183859950,0cyclictest0-21swapper/221:55:292
183859950,0cyclictest0-21swapper/221:35:512
183849955,0cyclictest0-21swapper/123:57:101
183849955,0cyclictest0-21swapper/123:36:211
183849955,0cyclictest0-21swapper/122:10:541
183849955,0cyclictest0-21swapper/121:54:491
183849955,0cyclictest0-21swapper/121:30:231
183849950,0cyclictest0-21swapper/123:14:071
183849950,0cyclictest0-21swapper/122:24:561
183849950,0cyclictest0-21swapper/121:42:501
183849950,0cyclictest0-21swapper/121:10:311
183849950,0cyclictest0-21swapper/119:25:221
183849950,0cyclictest0-21swapper/100:07:251
183829955,0cyclictest0-21swapper/021:04:430
183829955,0cyclictest0-21swapper/020:52:160
183829954,0cyclictest30056-21tr23:15:340
183829950,0cyclictest0-21swapper/023:43:290
183829950,0cyclictest0-21swapper/022:46:050
183829950,0cyclictest0-21swapper/022:06:410
179950,0migration/122269-21hddtemp_smartct20:00:321
179950,0migration/120696-21timerandwakeup22:05:461
179950,0migration/116523-21gltestperf20:20:331
169950,0watchdog/118770-21kthreadcore21:45:371
169950,0watchdog/10-21swapper/119:35:371
149950,0migration/08525-21kthreadcore22:00:360
149950,0migration/06544-21cpuspeed_turbos19:00:310
149950,0migration/06356-21taskset21:16:010
149950,0migration/04961-21runrttasks22:39:130
149950,0migration/03592-21taskset22:56:360
149950,0migration/03261-21latency_hist00:00:180
149950,0migration/030564-21munin-node18:50:370
149950,0migration/03038-21kthreadcore19:45:350
149950,0migration/030267-21kthreadcore20:05:370
149950,0migration/030232-21taskset21:31:230
149950,0migration/029874-21kthreadcore19:40:350
149950,0migration/028260-21kthreadcore21:10:370
149950,0migration/028213-21sh23:14:110
149950,0migration/026179-21processes19:35:400
149950,0migration/025730-21timerandwakeup23:50:420
149950,0migration/022734-21cpuspeed_turbos20:25:310
149950,0migration/021482-21latency_hist22:50:180
149950,0migration/020639-21kthreadcore21:05:370
149950,0migration/01943-21kthreadcore18:55:380
149950,0migration/019275-21taskset19:09:230
149950,0migration/017938-21kthreadcore19:30:370
149950,0migration/013089-21munin-node23:05:300
149950,0migration/012606-21irqrtprio00:05:360
149950,0migration/012319-21taskset22:42:140
149950,0migration/011953-21processes22:20:380
149950,0migration/010601-21netstat23:00:370
339940,0migration/37311-21irqcore19:00:343
339940,0migration/32478-21irqcore19:45:343
339940,0migration/319975-21taskset19:31:243
339940,0migration/317300-21kthreadcore23:05:363
29725040,0irq/27-eth0-tx-3386-21munin-node00:00:302
29725040,0irq/27-eth0-tx-21129-21ssh22:06:242
29725040,0irq/27-eth0-tx-0-21swapper/223:35:382
29725040,0irq/27-eth0-tx-0-21swapper/223:00:212
29725040,0irq/27-eth0-tx-0-21swapper/222:20:472
29725040,0irq/27-eth0-tx-0-21swapper/222:16:012
29725040,0irq/27-eth0-tx-0-21swapper/221:10:322
29725040,0irq/27-eth0-tx-0-21swapper/200:05:522
29725040,0irq/27-eth0-tx-0-21swapper/020:20:310
29725040,0irq/27-eth0-tx-0-21swapper/020:04:230
29725040,0irq/27-eth0-tx-0-21swapper/019:55:420
29725040,0irq/27-eth0-tx-0-21swapper/019:50:400
29725040,0irq/27-eth0-tx-0-21swapper/019:20:330
29715040,0irq/26-eth0-rx-0-21swapper/323:23:353
29715040,0irq/26-eth0-rx-0-21swapper/322:50:383
29715040,0irq/26-eth0-rx-0-21swapper/322:26:403
29715040,0irq/26-eth0-rx-0-21swapper/322:15:403
29715040,0irq/26-eth0-rx-0-21swapper/321:38:033
29715040,0irq/26-eth0-rx-0-21swapper/320:50:253
29715040,0irq/26-eth0-rx-0-21swapper/319:55:313
29715040,0irq/26-eth0-rx-0-21swapper/319:35:313
259940,0migration/26251-21munin-node19:20:412
259940,0migration/232539-21runrttasks19:18:502
259940,0migration/232539-21runrttasks19:18:502
259940,0migration/232055-21sshd18:55:332
259940,0migration/228244-21irqcore19:40:342
259940,0migration/225651-21runrttasks19:11:252
259940,0migration/221918-21df_abs22:50:312
259940,0migration/219351-21kthreadcore19:55:372
259940,0migration/216330-21kthreadcore19:05:372
259940,0migration/211878-21runrttasks23:45:232
259940,0migration/211321-21kthreadcore19:25:352
259940,0migration/210703-21kthreadcore21:40:372
249940,0watchdog/225001-21kthreadcore19:35:372
249940,0watchdog/219536-21cpuspeed_turbos00:10:282
249940,0watchdog/20-21swapper/221:50:292
249940,0watchdog/20-21swapper/220:40:372
183859943,0cyclictest3556-21lldpd20:24:222
183859943,0cyclictest3556-21lldpd19:49:222
183859943,0cyclictest3556-21lldpd18:51:502
183859943,0cyclictest3514-21snmpd20:46:442
183859943,0cyclictest3514-21snmpd20:25:292
183859943,0cyclictest30967-21awk22:35:332
183859943,0cyclictest30603-21grep20:30:352
183859943,0cyclictest29738-21awk23:15:332
183859943,0cyclictest27789-21munin-node23:55:312
183849944,0cyclictest0-21swapper/123:05:081
183849943,0cyclictest3556-21lldpd23:30:231
183849943,0cyclictest3556-21lldpd22:55:231
183849943,0cyclictest3556-21lldpd22:46:231
183849943,0cyclictest3556-21lldpd22:40:231
183849943,0cyclictest3556-21lldpd20:07:221
183849943,0cyclictest3556-21lldpd19:04:211
183849943,0cyclictest3556-21lldpd00:02:531
183849943,0cyclictest3265-21awk20:10:321
183849943,0cyclictest30885-21awk22:35:331
183849943,0cyclictest29820-21awk23:15:331
183849943,0cyclictest23391-21awk20:25:341
183849943,0cyclictest23075-21awk22:30:341
183849943,0cyclictest17820-21awk20:45:341
183849943,0cyclictest15718-21awk19:55:341
183829944,0cyclictest20921-21kworker/0:223:46:370
183829944,0cyclictest0-21swapper/022:17:330
183829944,0cyclictest0-21swapper/021:28:310
183829943,0cyclictest3556-21lldpd22:31:230
183829943,0cyclictest3514-21snmpd20:56:590
183829943,0cyclictest3514-21snmpd20:17:140
183829943,0cyclictest32210-21awk21:55:350
183829943,0cyclictest30355-21sadc22:15:180
183829943,0cyclictest15017-21awk22:25:320
183829943,0cyclictest10985-21awk20:40:340
179940,0migration/19143-21fschecks_time21:00:331
179940,0migration/1389-21irqcore21:35:341
179940,0migration/131288-21fschecks_time22:15:301
179940,0migration/130793-21kthreadcore19:40:361
179940,0migration/127218-21kthreadcore20:50:361
179940,0migration/125258-21runrttasks18:50:201
179940,0migration/122162-21kthreadcore19:10:361
179940,0migration/121391-21kthreadcore18:45:361
179940,0migration/120145-21idleruntime00:10:301
179940,0migration/116879-21kthreadcore23:45:361
179940,0migration/116791-21idleruntime21:25:341
179940,0migration/114836-21kthreadcore20:40:371
179940,0migration/114669-21kthreadcore23:05:351
179940,0migration/113623-21munin-node19:05:331
179940,0migration/111495-21kthreadcore21:20:361
179940,0migration/110094-21kthreadcore19:50:351
169940,0watchdog/14556-21perl23:40:321
169940,0watchdog/123242-21ssh21:07:171
169940,0watchdog/10-21swapper/123:50:361
169940,0watchdog/10-21swapper/123:27:321
169940,0watchdog/10-21swapper/123:20:361
169940,0watchdog/10-21swapper/122:00:371
169940,0watchdog/10-21swapper/121:55:371
169940,0watchdog/10-21swapper/120:15:331
169940,0watchdog/10-21swapper/119:30:371
169940,0watchdog/10-21swapper/118:55:411
149940,0migration/05934-21kthreadcore20:10:350
149940,0migration/031741-21kthreadcore23:55:360
149940,0migration/020777-21kthreadcore00:10:330
149940,0migration/019288-21runrttasks23:27:520
149940,0migration/012169-21kthreadcore19:25:350
149940,0migration/011439-21kthreadcore21:20:360
339930,0migration/329061-21runrttasks20:30:243
29715030,0irq/26-eth0-rx-0-21swapper/320:25:363
29715030,0irq/26-eth0-rx-0-21swapper/320:20:303
29715030,0irq/26-eth0-rx-0-21swapper/319:28:213
29715030,0irq/26-eth0-rx-0-21swapper/319:15:303
29715030,0irq/26-eth0-rx-0-21swapper/319:15:303
29715030,0irq/26-eth0-rx-0-21swapper/319:08:593
183859933,0cyclictest3556-21lldpd19:02:512
183859932,0cyclictest4263-21awk20:35:322
183859932,0cyclictest3556-21lldpd20:12:222
183859932,0cyclictest22248-21kthreadcore18:45:362
183859932,0cyclictest14086-21grep19:50:412
183849932,0cyclictest3556-21lldpd20:35:211
183849932,0cyclictest3556-21lldpd19:20:211
183849932,0cyclictest31455-21cat20:30:351
183849932,0cyclictest2313-21awk19:45:331
183849932,0cyclictest1235-21awk20:55:351
183829933,0cyclictest20921-21kworker/0:223:35:210
183829933,0cyclictest20921-21kworker/0:223:20:210
183829933,0cyclictest20921-21kworker/0:220:30:200
183829933,0cyclictest20921-21kworker/0:219:10:240
179930,0migration/13879-21kthreadcore21:15:361
179930,0migration/127205-21if_eth1.319:15:341
179930,0migration/127205-21if_eth1.319:15:341
169930,0watchdog/116580-21diskmemload22:28:441
29715020,0irq/26-eth0-rx-0-21swapper/320:40:273
29715020,0irq/26-eth0-rx-0-21swapper/318:50:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional