You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-16 - 08:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Mon Sep 16, 2024 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1762227271,0sleep30-21swapper/318:54:383
1732425241,0sleep20-21swapper/218:51:082
1642124847,0sleep10-21swapper/118:50:431
1736023423,0sleep00-21swapper/018:51:350
28415070,0irq/27-eth0-tx-29242-21munin-node22:05:452
28415070,0irq/27-eth0-tx-0-21swapper/223:13:032
177609976,0cyclictest0-21swapper/121:10:411
177599977,0cyclictest6445-21snmpd19:27:510
177599976,0cyclictest0-21swapper/020:58:260
339960,0migration/327481-21sh20:35:483
339960,0migration/321392-21sh21:15:593
339960,0migration/315882-21sh23:16:373
339960,0migration/312951-21df_abs22:15:373
28415060,0irq/27-eth0-tx-2627-21ssh22:27:502
28415060,0irq/27-eth0-tx-20044-21ssh21:35:462
28415060,0irq/27-eth0-tx-20044-21ssh21:35:462
28415060,0irq/27-eth0-tx-18953-21munin-node19:20:430
28415060,0irq/27-eth0-tx-15886-21ssh22:55:442
28415060,0irq/27-eth0-tx-0-21swapper/223:44:182
28415060,0irq/27-eth0-tx-0-21swapper/223:37:032
28415060,0irq/27-eth0-tx-0-21swapper/223:25:492
28415060,0irq/27-eth0-tx-0-21swapper/223:01:502
28415060,0irq/27-eth0-tx-0-21swapper/222:53:182
28415060,0irq/27-eth0-tx-0-21swapper/222:48:242
28415060,0irq/27-eth0-tx-0-21swapper/222:34:492
28415060,0irq/27-eth0-tx-0-21swapper/222:20:252
28415060,0irq/27-eth0-tx-0-21swapper/222:14:372
28415060,0irq/27-eth0-tx-0-21swapper/222:00:542
28415060,0irq/27-eth0-tx-0-21swapper/221:55:352
28415060,0irq/27-eth0-tx-0-21swapper/221:41:022
28415060,0irq/27-eth0-tx-0-21swapper/221:29:192
28415060,0irq/27-eth0-tx-0-21swapper/221:07:352
28415060,0irq/27-eth0-tx-0-21swapper/221:01:002
28415060,0irq/27-eth0-tx-0-21swapper/200:12:252
28415060,0irq/27-eth0-tx-0-21swapper/019:40:430
28415060,0irq/27-eth0-tx-0-21swapper/019:12:360
28405060,0irq/26-eth0-rx-6244-21ls21:30:253
28405060,0irq/26-eth0-rx-20492-21sh00:00:463
28405060,0irq/26-eth0-rx-11125-21python00:15:493
249960,0watchdog/20-21swapper/221:46:242
177629965,0cyclictest2855-21kworker/2:100:07:532
177609966,0cyclictest0-21swapper/100:14:411
177609960,0cyclictest0-21swapper/122:50:481
177609960,0cyclictest0-21swapper/120:25:361
149960,0migration/024157-21latency_hist23:45:250
149960,0migration/015258-21cpuspeed_turbos00:00:380
339950,0migration/36240-21taskset23:52:263
339950,0migration/33576-21runrttasks22:07:303
339950,0migration/329448-21pmu-power21:00:463
339950,0migration/327670-21kthreadcore23:25:403
339950,0migration/327082-21runrttasks22:45:263
339950,0migration/326438-21cpuspeed_turbos23:05:393
339950,0migration/324436-21latency_hist19:00:253
339950,0migration/323625-21fschecks_count21:20:393
339950,0migration/321754-21taskset21:39:313
339950,0migration/321754-21taskset21:39:313
339950,0migration/317985-21kthreadcore20:55:413
339950,0migration/317487-21aten_r1power_vo23:20:373
339950,0migration/317314-21kthreadcore20:30:413
339950,0migration/317115-21kthreadcore21:55:413
339950,0migration/313560-21munin-node19:40:383
339950,0migration/312847-21needreboot23:55:463
339950,0migration/312302-21hwlatdetect22:35:383
339950,0migration/312292-21taskset19:15:313
339950,0migration/311880-21unixbench_multi21:50:503
339950,0migration/311532-21kthreadcore20:50:423
339950,0migration/310837-21unixbench_multi22:10:483
339950,0migration/310281-21kthreadcore20:00:423
28415050,0irq/27-eth0-tx-6372-21iceccd19:57:170
28415050,0irq/27-eth0-tx-26155-21munin-node23:05:432
28415050,0irq/27-eth0-tx-15146-21ssh21:15:282
28415050,0irq/27-eth0-tx-0-21swapper/223:55:292
28415050,0irq/27-eth0-tx-0-21swapper/223:22:582
28415050,0irq/27-eth0-tx-0-21swapper/222:35:282
28415050,0irq/27-eth0-tx-0-21swapper/221:50:532
28415050,0irq/27-eth0-tx-0-21swapper/221:31:032
28415050,0irq/27-eth0-tx-0-21swapper/221:20:562
28415050,0irq/27-eth0-tx-0-21swapper/020:43:000
28405050,0irq/26-eth0-rx-555-21kernelversion21:05:413
28405050,0irq/26-eth0-rx-26943-21netstat22:00:453
28405050,0irq/26-eth0-rx-24262-21ssh23:45:313
28405050,0irq/26-eth0-rx-23176-21perl00:05:423
28405050,0irq/26-eth0-rx-22320-21wc23:40:483
28405050,0irq/26-eth0-rx-20740-21cpuspeed_turbos22:20:383
28405050,0irq/26-eth0-rx-20256-21kthreadcore23:00:413
28405050,0irq/26-eth0-rx-1470-21kthreadcore21:45:453
28405050,0irq/26-eth0-rx-1270-21kthreadcore00:10:443
28405050,0irq/26-eth0-rx-0-21swapper/323:10:473
28405050,0irq/26-eth0-rx-0-21swapper/322:55:433
28405050,0irq/26-eth0-rx-0-21swapper/322:25:433
259950,0migration/25035-21latency23:50:442
259950,0migration/214025-21irqrtprio00:20:442
249950,0watchdog/25802-21sort00:15:392
249950,0watchdog/20-21swapper/223:45:442
249950,0watchdog/20-21swapper/223:30:402
249950,0watchdog/20-21swapper/223:15:442
249950,0watchdog/20-21swapper/222:42:202
249950,0watchdog/20-21swapper/222:15:282
249950,0watchdog/20-21swapper/221:13:362
249950,0watchdog/20-21swapper/220:53:042
249950,0watchdog/20-21swapper/220:35:402
249950,0watchdog/20-21swapper/220:26:242
249950,0watchdog/20-21swapper/220:14:002
249950,0watchdog/20-21swapper/220:04:162
249950,0watchdog/20-21swapper/219:25:482
249950,0watchdog/20-21swapper/219:20:362
249950,0watchdog/20-21swapper/219:14:122
249950,0watchdog/20-21swapper/219:05:442
249950,0watchdog/20-21swapper/218:57:402
249950,0watchdog/20-21swapper/200:00:442
177629954,0cyclictest2855-21kworker/2:120:57:212
177609955,0cyclictest15891-21diskmemload23:27:511
177609955,0cyclictest0-21swapper/123:17:361
177609954,0cyclictest32036-21kworker/1:223:14:311
177609954,0cyclictest32036-21kworker/1:222:45:351
177609950,0cyclictest0-21swapper/121:56:441
177599955,0cyclictest0-21swapper/023:30:530
177599955,0cyclictest0-21swapper/022:42:010
177599954,0cyclictest6445-21snmpd00:11:110
179950,0migration/15150-21munin-node22:10:381
179950,0migration/130787-21kthreadcore22:05:391
179950,0migration/129518-21kthreadcore20:15:421
179950,0migration/124157-21switchtime23:00:481
179950,0migration/121658-21kthreadcore19:45:421
179950,0migration/121444-21munin-node22:20:421
179950,0migration/116237-21sh22:55:471
179950,0migration/112253-21smart_sda19:35:471
169950,0watchdog/17468-21taskset20:20:481
169950,0watchdog/122030-21timerwakeupswit20:55:481
149950,0migration/09487-21aten_r1power_cu20:50:360
149950,0migration/08573-21timerandwakeup20:45:480
149950,0migration/03574-21kthreadcore19:30:420
149950,0migration/031916-21munin-node19:50:440
149950,0migration/030912-21kthreadcore22:45:440
149950,0migration/02957-21sh22:28:540
149950,0migration/027003-21taskset20:13:010
149950,0migration/02673-21aten_r1power_po22:50:370
149950,0migration/026517-21kthreadcore23:25:400
149950,0migration/023638-21sh23:21:250
149950,0migration/023076-21kthreadcore22:20:430
149950,0migration/022846-21kthreadcore18:55:430
149950,0migration/020716-21kthreadcore23:40:430
149950,0migration/019816-21smart_sdb20:05:470
149950,0migration/015722-21fschecks_time20:30:380
149950,0migration/01454-21latency_hist23:10:250
149950,0migration/014071-21taskset21:35:120
149950,0migration/011642-21kthreadcore21:10:420
149950,0migration/011626-21aten_r1power_po22:35:350
149950,0migration/011555-21irqcore22:55:410
339940,0migration/39864-21diskmemload22:30:493
339940,0migration/37997-21taskset20:22:573
339940,0migration/331020-21kthreadcore20:40:423
339940,0migration/322322-21aten_r1power_cu21:40:353
339940,0migration/319564-21netstat20:05:443
339940,0migration/311439-21kthreadcore20:25:423
28415040,0irq/27-eth0-tx-0-21swapper/020:25:360
28405040,0irq/26-eth0-rx-8981-21ssh22:51:403
28405040,0irq/26-eth0-rx-0-21swapper/323:37:223
28405040,0irq/26-eth0-rx-0-21swapper/323:30:483
28405040,0irq/26-eth0-rx-0-21swapper/321:30:313
28405040,0irq/26-eth0-rx-0-21swapper/321:10:513
28405040,0irq/26-eth0-rx-0-21swapper/320:12:553
259940,0migration/27143-21kthreadcore20:45:422
259940,0migration/210418-21kthreadcore19:35:432
249940,0watchdog/20-21swapper/220:40:362
249940,0watchdog/20-21swapper/220:16:482
249940,0watchdog/20-21swapper/219:55:442
249940,0watchdog/20-21swapper/219:50:322
177629944,0cyclictest2855-21kworker/2:120:30:512
177629944,0cyclictest2855-21kworker/2:120:21:112
177629944,0cyclictest2855-21kworker/2:119:40:312
177629944,0cyclictest2855-21kworker/2:119:30:292
177629944,0cyclictest2855-21kworker/2:119:15:472
177629944,0cyclictest2855-21kworker/2:119:00:372
177629943,0cyclictest6445-21snmpd20:05:532
177629943,0cyclictest20705-21awk19:45:402
177609944,0cyclictest3669-21kworker/1:019:00:311
177609944,0cyclictest3669-21kworker/1:018:56:011
177609944,0cyclictest32036-21kworker/1:223:45:451
177609944,0cyclictest32036-21kworker/1:223:41:411
177609944,0cyclictest32036-21kworker/1:223:35:391
177609944,0cyclictest32036-21kworker/1:222:31:351
177609944,0cyclictest32036-21kworker/1:222:00:411
177609944,0cyclictest32036-21kworker/1:221:45:471
177609944,0cyclictest32036-21kworker/1:221:40:451
177609944,0cyclictest32036-21kworker/1:221:25:411
177609944,0cyclictest32036-21kworker/1:221:08:431
177609944,0cyclictest32036-21kworker/1:221:00:371
177609944,0cyclictest32036-21kworker/1:220:43:151
177609944,0cyclictest32036-21kworker/1:220:35:331
177609944,0cyclictest32036-21kworker/1:220:31:451
177609944,0cyclictest32036-21kworker/1:220:00:351
177609944,0cyclictest32036-21kworker/1:219:52:231
177609944,0cyclictest32036-21kworker/1:219:31:031
177609944,0cyclictest32036-21kworker/1:219:16:451
177609944,0cyclictest32036-21kworker/1:219:10:291
177609944,0cyclictest0-21swapper/123:20:551
177609943,0cyclictest32036-21kworker/1:223:50:491
177609943,0cyclictest32036-21kworker/1:222:17:111
177609943,0cyclictest32036-21kworker/1:221:50:491
177609943,0cyclictest15280-21awk21:35:401
177609943,0cyclictest15280-21awk21:35:401
177599944,0cyclictest0-21swapper/023:17:010
177599944,0cyclictest0-21swapper/022:20:160
177599944,0cyclictest0-21swapper/022:12:230
177599944,0cyclictest0-21swapper/019:00:490
177599943,0cyclictest7467-21awk19:35:400
177599943,0cyclictest6445-21snmpd22:32:090
177599943,0cyclictest6445-21snmpd21:40:240
177599943,0cyclictest6445-21snmpd21:40:240
177599943,0cyclictest6445-21snmpd20:16:230
177599943,0cyclictest6445-21snmpd19:19:230
177599943,0cyclictest3425-21lldpd21:06:270
177599943,0cyclictest3425-21lldpd21:00:570
177599943,0cyclictest3425-21lldpd20:03:260
177599943,0cyclictest3425-21lldpd19:48:260
177599943,0cyclictest31184-21awk21:45:420
177599943,0cyclictest23185-21awk21:40:400
177599943,0cyclictest13714-21awk00:20:430
179940,0migration/19582-21kthreadcore23:55:441
179940,0migration/1844-21cpuspeed_turbos23:30:371
179940,0migration/1317-21kthreadcore19:05:411
179940,0migration/130064-21kthreadcore22:25:421
179940,0migration/126909-21taskset20:11:541
179940,0migration/124399-21diskmemload00:05:451
179940,0migration/122209-21kthreadcore22:40:411
179940,0migration/119346-21df_abs19:20:381
179940,0migration/119329-21runrttasks00:22:131
179940,0migration/117102-21kthreadcore21:15:421
179940,0migration/114164-21kthreadcore20:50:431
179940,0migration/113619-21df_abs19:40:381
179940,0migration/111612-21aten_r1power_po22:35:351
169940,0watchdog/130708-21grep19:25:441
169940,0watchdog/127030-21cut21:20:441
169940,0watchdog/112744-21ssh21:31:041
169940,0watchdog/10-21swapper/123:05:441
169940,0watchdog/10-21swapper/119:55:441
169940,0watchdog/10-21swapper/100:15:391
169940,0watchdog/10-21swapper/100:00:441
149940,0migration/0675-21irqcore23:50:420
149940,0migration/010839-21kthreadcore23:35:400
35130,0ktimersoftd/30-21swapper/319:32:023
28415030,0irq/27-eth0-tx-0-21swapper/020:35:370
28415030,0irq/27-eth0-tx-0-21swapper/019:05:360
28405030,0irq/26-eth0-rx-0-21swapper/322:40:333
28405030,0irq/26-eth0-rx-0-21swapper/320:46:553
28405030,0irq/26-eth0-rx-0-21swapper/319:55:393
28405030,0irq/26-eth0-rx-0-21swapper/319:51:143
28405030,0irq/26-eth0-rx-0-21swapper/319:47:143
28405030,0irq/26-eth0-rx-0-21swapper/319:39:453
28405030,0irq/26-eth0-rx-0-21swapper/319:20:273
28405030,0irq/26-eth0-rx-0-21swapper/319:13:083
28405030,0irq/26-eth0-rx-0-21swapper/319:05:523
28405030,0irq/26-eth0-rx-0-21swapper/300:20:403
177609933,0cyclictest32036-21kworker/1:220:45:391
177609930,0cyclictest15022-21munin-node20:05:401
177599933,0cyclictest8227-21awk23:55:420
177599933,0cyclictest0-21swapper/000:08:060
177599932,0cyclictest8545-21kthreadcore00:15:430
177599932,0cyclictest31738-21grep21:25:400
177599932,0cyclictest30227-21awk22:05:380
177599932,0cyclictest29918-21cut23:05:450
177599932,0cyclictest24296-21cat23:00:480
177599932,0cyclictest2333-21fschecks_time20:20:390
177599932,0cyclictest21629-21stty22:00:380
177599932,0cyclictest20989-21swap21:15:470
177599932,0cyclictest10534-21kthreadcore21:50:450
177599930,0cyclictest16288-21grep21:55:410
149930,0migration/030128-21sh21:23:430
339920,0migration/327848-21diskstats20:15:383
28405020,0irq/26-eth0-rx-0-21swapper/319:26:263
28405020,0irq/26-eth0-rx-0-21swapper/319:00:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional