You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 16:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Dec 06, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2561724433,0sleep00-21swapper/006:35:570
2580023825,0sleep20-21swapper/206:38:072
291350350,0irq/25-eth10-21swapper/306:35:283
1929923424,0sleep10-21swapper/106:34:061
259539988,0cyclictest0-21swapper/008:39:300
28415070,0irq/27-eth0-tx-0-21swapper/008:26:490
259539977,0cyclictest18867-21awk11:39:190
339960,0migration/31970-21sh10:24:533
339960,0migration/314618-21sh08:51:143
339960,0migration/314304-21sh09:11:583
28415060,0irq/27-eth0-tx-14824-21munin-node07:19:220
28415060,0irq/27-eth0-tx-0-21swapper/212:07:282
28415060,0irq/27-eth0-tx-0-21swapper/211:48:172
28415060,0irq/27-eth0-tx-0-21swapper/211:38:302
28415060,0irq/27-eth0-tx-0-21swapper/211:30:152
28415060,0irq/27-eth0-tx-0-21swapper/211:25:412
28415060,0irq/27-eth0-tx-0-21swapper/211:16:142
28415060,0irq/27-eth0-tx-0-21swapper/210:15:342
28415060,0irq/27-eth0-tx-0-21swapper/210:09:182
28415060,0irq/27-eth0-tx-0-21swapper/209:51:312
28415060,0irq/27-eth0-tx-0-21swapper/209:47:132
28415060,0irq/27-eth0-tx-0-21swapper/209:34:142
28415060,0irq/27-eth0-tx-0-21swapper/209:32:142
28415060,0irq/27-eth0-tx-0-21swapper/209:25:522
28415060,0irq/27-eth0-tx-0-21swapper/209:22:562
28415060,0irq/27-eth0-tx-0-21swapper/209:11:282
28415060,0irq/27-eth0-tx-0-21swapper/209:00:332
28415060,0irq/27-eth0-tx-0-21swapper/208:55:412
28415060,0irq/27-eth0-tx-0-21swapper/208:45:032
28415060,0irq/27-eth0-tx-0-21swapper/008:34:180
28415060,0irq/27-eth0-tx-0-21swapper/008:14:470
28415060,0irq/27-eth0-tx-0-21swapper/006:52:060
28405060,0irq/26-eth0-rx-25027-21kthreadcore10:19:253
28405060,0irq/26-eth0-rx-0-21swapper/310:14:213
259559965,0cyclictest27003-21grep07:49:242
259559960,0cyclictest0-21swapper/208:39:322
259549966,0cyclictest0-21swapper/109:44:251
259539965,0cyclictest0-21swapper/009:24:060
169960,0watchdog/120069-21cut08:34:241
149960,0migration/029314-21aten_r1power_po10:04:180
149960,0migration/02006-21sh10:24:590
149960,0migration/010122-21sh10:09:260
339950,0migration/3899-21runrttasks11:06:453
339950,0migration/37893-21unixbench_singl11:29:313
339950,0migration/35341-21sh09:26:103
339950,0migration/34751-21kthreadcore08:44:253
339950,0migration/332239-21taskset06:40:043
339950,0migration/331419-21kthreadcore07:04:253
339950,0migration/330068-21kthreadcore11:24:233
339950,0migration/329584-21runrttasks09:43:083
339950,0migration/325457-21runrttasks11:23:063
339950,0migration/317411-21ksmtuned10:34:293
339950,0migration/316231-21munin-node07:44:203
339950,0migration/315037-21kthreadcore11:54:263
339950,0migration/314977-21kthreadcore11:14:263
339950,0migration/313726-21proc_pri07:14:263
339950,0migration/31176-21sh06:44:203
339950,0migration/311167-21taskset08:29:123
339950,0migration/310934-21munin-node10:54:313
339950,0migration/310736-21sh10:32:163
339950,0migration/310120-21munin-node10:09:263
28415050,0irq/27-eth0-tx-26166-21munin-node06:39:170
28415050,0irq/27-eth0-tx-11040-21grep11:54:242
28415050,0irq/27-eth0-tx-0-21swapper/212:00:182
28415050,0irq/27-eth0-tx-0-21swapper/211:49:142
28415050,0irq/27-eth0-tx-0-21swapper/211:23:422
28415050,0irq/27-eth0-tx-0-21swapper/211:12:092
28415050,0irq/27-eth0-tx-0-21swapper/211:01:442
28415050,0irq/27-eth0-tx-0-21swapper/210:56:272
28415050,0irq/27-eth0-tx-0-21swapper/210:45:132
28415050,0irq/27-eth0-tx-0-21swapper/210:39:292
28415050,0irq/27-eth0-tx-0-21swapper/210:29:202
28415050,0irq/27-eth0-tx-0-21swapper/210:26:092
28415050,0irq/27-eth0-tx-0-21swapper/210:20:112
28415050,0irq/27-eth0-tx-0-21swapper/210:04:072
28415050,0irq/27-eth0-tx-0-21swapper/210:02:462
28415050,0irq/27-eth0-tx-0-21swapper/209:54:472
28415050,0irq/27-eth0-tx-0-21swapper/209:15:082
28415050,0irq/27-eth0-tx-0-21swapper/209:05:042
28415050,0irq/27-eth0-tx-0-21swapper/008:12:220
28405050,0irq/26-eth0-rx-7056-21latency_hist06:49:053
28405050,0irq/26-eth0-rx-3559-21python09:44:283
28405050,0irq/26-eth0-rx-2910-21aten_r1power_en10:49:173
28405050,0irq/26-eth0-rx-25713-21ps08:39:223
28405050,0irq/26-eth0-rx-23143-21grep09:59:243
28405050,0irq/26-eth0-rx-21618-21kthreadcore10:59:243
28405050,0irq/26-eth0-rx-2006-21munin-node11:09:173
28405050,0irq/26-eth0-rx-18246-21tr08:09:233
28405050,0irq/26-eth0-rx-18225-21aten_r1power_vo11:59:193
28405050,0irq/26-eth0-rx-17858-21cut08:54:223
28405050,0irq/26-eth0-rx-15451-21ntp_kernel_pll_11:34:263
28405050,0irq/26-eth0-rx-0-21swapper/312:08:333
28405050,0irq/26-eth0-rx-0-21swapper/311:48:543
28405050,0irq/26-eth0-rx-0-21swapper/311:42:153
28405050,0irq/26-eth0-rx-0-21swapper/310:41:203
28405050,0irq/26-eth0-rx-0-21swapper/310:04:183
28405050,0irq/26-eth0-rx-0-21swapper/309:54:433
28405050,0irq/26-eth0-rx-0-21swapper/309:23:523
259559955,0cyclictest0-21swapper/208:49:282
259549955,0cyclictest0-21swapper/111:52:261
259549955,0cyclictest0-21swapper/111:48:101
259549955,0cyclictest0-21swapper/109:56:141
259549950,0cyclictest0-21swapper/109:53:331
259539950,0cyclictest0-21swapper/007:24:260
259950,0migration/231667-21munin-node06:39:292
259950,0migration/227941-21diskmemload09:39:312
259950,0migration/212100-21kthreadcore06:49:232
249950,0watchdog/227888-21kthreadcore11:04:242
249950,0watchdog/220070-21tr08:34:242
249950,0watchdog/212744-21kthreadcore08:29:242
249950,0watchdog/20-21swapper/211:41:082
19150,0ktimersoftd/10-21swapper/110:55:541
179950,0migration/1888-21kthreadcore07:29:241
179950,0migration/128151-21kthreadcore12:04:391
179950,0migration/128078-21kthreadcore06:39:251
179950,0migration/120629-21munin-node10:19:201
179950,0migration/118656-21kthreadcore09:34:241
179950,0migration/116845-21aten_r1power_fr08:09:171
179950,0migration/116058-21munin-node08:04:291
179950,0migration/115148-21kthreadcore10:14:221
179950,0migration/113759-21timerandwakeup08:49:281
169950,0watchdog/132104-21port_sshpriv11:04:281
169950,0watchdog/122993-21cut07:24:241
169950,0watchdog/10-21swapper/110:11:241
169950,0watchdog/10-21swapper/109:24:321
169950,0watchdog/10-21swapper/109:19:241
169950,0watchdog/10-21swapper/109:01:241
169950,0watchdog/10-21swapper/108:44:241
149950,0migration/0616-21taskset12:06:330
149950,0migration/05043-21munin-node09:04:290
149950,0migration/03257-21kthreadcore11:29:240
149950,0migration/025878-21kthreadcore08:59:280
149950,0migration/025618-21kthreadcore09:19:230
149950,0migration/02259-21cpuspeed_turbos11:09:180
149950,0migration/02193-21kthreadcore09:44:230
149950,0migration/020567-21kthreadcore08:54:230
149950,0migration/019843-21kthreadcore07:44:240
149950,0migration/01862-21taskset07:30:300
149950,0migration/018312-21kthreadcore09:14:230
149950,0migration/016334-21kthreadcore09:54:250
149950,0migration/01623-21sh11:08:530
149950,0migration/013903-21kthreadcore08:04:230
149950,0migration/01374-21sh10:45:180
149950,0migration/01373-21sh11:48:500
149950,0migration/012111-21kthreadcore07:39:220
149950,0migration/011609-21kthreadcore09:09:240
149950,0migration/010727-21idleruntime11:34:210
339940,0migration/332592-21kthreadcore08:19:313
339940,0migration/329489-21df_abs07:54:203
339940,0migration/328340-21if_eth110:44:213
339940,0migration/314655-21aten_r1power_vo09:34:183
28415040,0irq/27-eth0-tx-353-21munin-node06:44:190
28415040,0irq/27-eth0-tx-29132-21munin-node07:54:170
28415040,0irq/27-eth0-tx-0-21swapper/008:19:300
28415040,0irq/27-eth0-tx-0-21swapper/007:59:190
28415040,0irq/27-eth0-tx-0-21swapper/007:04:230
28405040,0irq/26-eth0-rx-6573-21if_err_eth1.209:49:213
28405040,0irq/26-eth0-rx-25330-21kthreadcore08:59:283
28405040,0irq/26-eth0-rx-0-21swapper/311:51:073
28405040,0irq/26-eth0-rx-0-21swapper/309:29:513
28405040,0irq/26-eth0-rx-0-21swapper/309:14:133
28405040,0irq/26-eth0-rx-0-21swapper/309:07:433
28405040,0irq/26-eth0-rx-0-21swapper/308:14:203
259559943,0cyclictest6445-21snmpd08:19:422
259559943,0cyclictest6445-21snmpd07:34:122
259559943,0cyclictest6445-21snmpd06:46:112
259559943,0cyclictest4426-21awk07:59:232
259559943,0cyclictest3425-21lldpd08:25:192
259559943,0cyclictest3425-21lldpd07:20:312
259559943,0cyclictest27984-21awk07:04:222
259559943,0cyclictest11084-21awk08:04:212
259549943,0cyclictest6445-21snmpd08:41:271
259549943,0cyclictest6445-21snmpd07:17:121
259549943,0cyclictest6445-21snmpd07:12:121
259549943,0cyclictest6445-21snmpd06:48:111
259549943,0cyclictest4542-21awk10:29:231
259549943,0cyclictest3425-21lldpd08:54:341
259549943,0cyclictest32676-21awk09:04:231
259549943,0cyclictest2892-21awk11:09:211
259549943,0cyclictest25313-21kworker/1:011:01:451
259549943,0cyclictest25313-21kworker/1:010:25:491
259549943,0cyclictest25313-21kworker/1:010:07:011
259549943,0cyclictest18942-21awk11:19:201
259539944,0cyclictest0-21swapper/011:53:520
259539944,0cyclictest0-21swapper/011:24:420
259539944,0cyclictest0-21swapper/010:58:040
259539944,0cyclictest0-21swapper/010:30:000
259539944,0cyclictest0-21swapper/008:50:210
259539943,0cyclictest6445-21snmpd07:52:420
259539943,0cyclictest19937-21sadc10:19:050
259539940,0cyclictest0-21swapper/010:23:050
259539940,0cyclictest0-21swapper/008:29:210
259940,0migration/29757-21kthreadcore07:14:222
259940,0migration/25747-21kthreadcore10:49:232
259940,0migration/229629-21runrttasks08:16:392
259940,0migration/22001-21fschecks_time07:09:192
259940,0migration/213066-21kthreadcore07:39:222
249940,0watchdog/230929-21kthreadcore07:54:242
249940,0watchdog/215506-21kthreadcore10:34:242
249940,0watchdog/20-21swapper/206:59:202
179940,0migration/19905-21kthreadcore09:09:241
179940,0migration/19522-21sh10:50:481
179940,0migration/125808-21kthreadcore09:59:251
179940,0migration/124965-21taskset11:41:471
179940,0migration/123966-21fschecks_count08:14:221
179940,0migration/120459-21kthreadcore07:44:251
179940,0migration/116072-21hwlatdetect09:14:201
179940,0migration/111631-21aten_r1power_en10:34:171
169940,0watchdog/129819-21kthreadcore07:04:241
169940,0watchdog/128151-21python07:49:281
169940,0watchdog/125725-21ssh10:39:401
169940,0watchdog/113463-21taskset06:52:401
169940,0watchdog/112927-21ssh09:29:561
169940,0watchdog/112746-21kthreadcore08:29:241
169940,0watchdog/110310-21df_inode11:34:201
169940,0watchdog/10-21swapper/111:59:241
169940,0watchdog/10-21swapper/111:31:241
169940,0watchdog/10-21swapper/111:17:521
169940,0watchdog/10-21swapper/110:48:121
169940,0watchdog/10-21swapper/109:39:281
169940,0watchdog/10-21swapper/107:34:241
149940,0migration/029580-21runrttasks09:43:070
149940,0migration/022271-21gltestperf09:59:210
149940,0migration/021149-21fschecks_time06:59:200
149940,0migration/017514-21runrttasks11:18:170
149940,0migration/015109-21fschecks_time09:34:200
149940,0migration/015000-21kthreadcore11:54:260
149940,0migration/01491-21aten_r1power_fr07:09:170
149940,0migration/010823-21kthreadcore07:14:220
4130,0ktimersoftd/08822-21runrttasks07:37:580
4130,0ktimersoftd/019931-21runrttasks06:55:470
339930,0migration/313238-21kthreadcore08:04:233
28405030,0irq/26-eth0-rx-0-21swapper/308:34:263
28405030,0irq/26-eth0-rx-0-21swapper/308:03:043
28405030,0irq/26-eth0-rx-0-21swapper/307:49:173
28405030,0irq/26-eth0-rx-0-21swapper/307:39:163
28405030,0irq/26-eth0-rx-0-21swapper/307:37:513
28405030,0irq/26-eth0-rx-0-21swapper/307:29:193
28405030,0irq/26-eth0-rx-0-21swapper/307:28:053
28405030,0irq/26-eth0-rx-0-21swapper/307:19:203
28405030,0irq/26-eth0-rx-0-21swapper/307:12:243
28405030,0irq/26-eth0-rx-0-21swapper/306:59:213
28405030,0irq/26-eth0-rx-0-21swapper/306:54:263
259559933,0cyclictest28785-21fschecks_time07:29:202
259559932,0cyclictest6445-21snmpd06:54:422
259559932,0cyclictest3425-21lldpd07:44:132
259549933,0cyclictest25313-21kworker/1:011:24:131
259549933,0cyclictest2399-21kworker/1:208:24:071
259549933,0cyclictest2399-21kworker/1:208:19:071
259549933,0cyclictest2399-21kworker/1:207:59:131
259549933,0cyclictest2399-21kworker/1:207:39:051
259549933,0cyclictest1156-21kworker/1:007:19:071
259549933,0cyclictest1156-21kworker/1:006:59:071
259549933,0cyclictest1156-21kworker/1:006:54:111
259539933,0cyclictest3425-21lldpd10:37:020
259539933,0cyclictest0-21swapper/009:50:160
259539932,0cyclictest838-21awk08:44:210
259539932,0cyclictest20485-21awk10:39:210
259539932,0cyclictest18494-21entropy11:59:210
259539930,0cyclictest6678-21tr10:49:230
259539930,0cyclictest0-21swapper/009:29:100
259930,0migration/221729-21kthreadcore08:09:242
249930,0watchdog/20-21swapper/207:24:242
169930,0watchdog/10-21swapper/111:54:081
169930,0watchdog/10-21swapper/107:54:081
149930,0migration/025650-21sh11:23:440
149930,0migration/025637-21sh11:02:260
28405020,0irq/26-eth0-rx-0-21swapper/308:24:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional