You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 23:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Wed Dec 17, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3090623727,0sleep30-21swapper/307:09:373
3063423626,0sleep20-21swapper/207:06:282
3078523425,0sleep10-21swapper/107:08:111
3065523329,0sleep00-21swapper/007:06:420
339970,0migration/326138-21diskmemload12:12:003
310429970,0cyclictest0-21swapper/009:00:410
339960,0migration/39294-21sh09:41:303
339960,0migration/330131-21sh12:31:113
339960,0migration/323195-21sh10:07:143
339960,0migration/321762-21munin-node10:25:393
339960,0migration/321442-21sh12:27:153
339960,0migration/31701-21kthreadcore12:35:413
339960,0migration/313757-21sh11:49:303
29815060,0irq/29-eth0-tx-9882-21munin-node07:40:360
29815060,0irq/29-eth0-tx-31749-21munin-node08:40:460
29815060,0irq/29-eth0-tx-2506-21munin-node07:35:370
29815060,0irq/29-eth0-tx-0-21swapper/008:25:370
29805060,0irq/28-eth0-rx-19117-21ssh10:23:423
149960,0migration/027773-21latency_hist08:15:240
149960,0migration/024145-21sh10:45:090
149960,0migration/019785-21sh08:05:460
149960,0migration/01097-21kthreadcore07:55:420
8305050,0irq/26-0000:00:24081-21dump-pmu-power07:50:242
8305050,0irq/26-0000:00:14360-21sed11:50:242
339950,0migration/37775-21if_eth008:45:403
339950,0migration/37055-21fschecks_time08:00:373
339950,0migration/35995-21diskmemload09:25:253
339950,0migration/34699-21taskset11:44:483
339950,0migration/33698-21kthreadcore12:00:423
339950,0migration/332726-21kthreadcore11:05:423
339950,0migration/330436-21kthreadcore12:15:403
339950,0migration/329356-21kthreadcore07:50:423
339950,0migration/329158-21fschecks_time09:00:383
339950,0migration/329001-21irqcore07:30:393
339950,0migration/328462-21fschecks_count08:15:373
339950,0migration/327622-21kthreadcore10:10:423
339950,0migration/327375-21taskset09:18:043
339950,0migration/326000-21irqrtprio10:45:403
339950,0migration/325099-21gltestperf11:20:393
339950,0migration/324794-21sh11:55:403
339950,0migration/324116-21kthreadcore08:10:403
339950,0migration/323537-21kthreadcore09:50:413
339950,0migration/315645-21aten_r1power_en09:30:353
339950,0migration/314999-21munin-node08:05:403
339950,0migration/313087-21kthreadcore11:30:423
339950,0migration/310390-21fschecks_time12:05:383
329950,0watchdog/37383-21grep09:05:433
329950,0watchdog/34219-21kthreadcore07:10:543
329950,0watchdog/326116-21if_eth009:35:393
329950,0watchdog/325654-21kthreadcore08:55:433
329950,0watchdog/325654-21kthreadcore08:55:433
329950,0watchdog/324983-21cut11:35:433
310439955,0cyclictest0-21swapper/110:37:111
310439955,0cyclictest0-21swapper/110:30:141
310439955,0cyclictest0-21swapper/110:16:121
310439955,0cyclictest0-21swapper/108:05:401
310439954,0cyclictest409-21awk08:40:391
310439950,0cyclictest0-21swapper/112:01:501
310439950,0cyclictest0-21swapper/111:35:021
310439950,0cyclictest0-21swapper/111:28:151
310429955,0cyclictest0-21swapper/012:27:260
310429955,0cyclictest0-21swapper/011:35:340
29815050,0irq/29-eth0-tx-6101-21munin-node09:25:462
29815050,0irq/29-eth0-tx-5806-21munin-node11:10:452
29815050,0irq/29-eth0-tx-4816-21munin-node12:20:422
29815050,0irq/29-eth0-tx-3749-21sensors_fan09:55:452
29815050,0irq/29-eth0-tx-24989-21munin-node10:10:372
29815050,0irq/29-eth0-tx-24060-21diskstats11:55:372
29815050,0irq/29-eth0-tx-20434-21grep11:15:432
29815050,0irq/29-eth0-tx-14246-21kthreadcore09:45:412
29815050,0irq/29-eth0-tx-13308-21munin-node07:20:350
29815050,0irq/29-eth0-tx-0-21swapper/212:10:402
29815050,0irq/29-eth0-tx-0-21swapper/211:03:572
29815050,0irq/29-eth0-tx-0-21swapper/008:30:410
29805050,0irq/28-eth0-rx-6878-21tune2fs07:15:363
29805050,0irq/28-eth0-rx-6314-21runrttasks09:45:453
29805050,0irq/28-eth0-rx-27324-21ssh11:02:313
29805050,0irq/28-eth0-rx-23643-21cut07:25:413
29805050,0irq/28-eth0-rx-18615-21irqcore08:30:413
29805050,0irq/28-eth0-rx-17116-21kthreadcore10:40:423
29805050,0irq/28-eth0-rx-0-21swapper/312:21:253
29805050,0irq/28-eth0-rx-0-21swapper/311:25:423
29805050,0irq/28-eth0-rx-0-21swapper/311:10:413
29805050,0irq/28-eth0-rx-0-21swapper/310:40:083
29805050,0irq/28-eth0-rx-0-21swapper/309:21:073
29805050,0irq/28-eth0-rx-0-21swapper/309:10:383
27150,0ktimersoftd/20-21swapper/211:45:082
259950,0migration/24056-21kthreadcore10:50:412
259950,0migration/23887-21kthreadcore12:35:422
259950,0migration/23450-21sh11:06:022
259950,0migration/228925-21munin-node09:20:362
259950,0migration/219281-21sh10:24:022
259950,0migration/215734-21cpuspeed_turbos10:40:372
259950,0migration/212658-21kthreadcore09:10:422
259950,0migration/211645-21sendmail_mailqu11:45:452
19150,0ktimersoftd/10-21swapper/112:27:511
179950,0migration/14417-21sh09:56:251
179950,0migration/13200-21df_abs08:20:361
179950,0migration/12289-21aten_r1power_vo09:40:351
179950,0migration/120816-21idleruntime11:00:391
179950,0migration/11142-21kthreadcore12:15:411
169950,0watchdog/121755-21awk09:50:391
149950,0migration/08608-21kthreadcore10:35:410
149950,0migration/06855-21fschecks_time09:25:380
149950,0migration/06606-21kthreadcore10:15:430
149950,0migration/0625-21kthreadcore08:15:420
149950,0migration/05835-21sh11:10:340
149950,0migration/05700-21kthreadcore09:05:420
149950,0migration/05538-21cpuspeed_turbos11:45:360
149950,0migration/0512-21fschecks_count12:35:380
149950,0migration/0331-21irqrtprio07:10:530
149950,0migration/031274-21processes09:35:450
149950,0migration/029912-21kthreadcore10:45:410
149950,0migration/028758-21munin-node11:40:360
149950,0migration/028039-21kthreadcore11:55:420
149950,0migration/027043-21sh11:01:550
149950,0migration/026704-21kthreadcore08:55:430
149950,0migration/026704-21kthreadcore08:55:430
149950,0migration/025895-21sh12:11:290
149950,0migration/024684-21df_abs07:50:360
149950,0migration/020100-21latency_hist10:25:240
149950,0migration/018775-21sh10:22:580
149950,0migration/018685-21sh11:34:440
149950,0migration/017766-21kthreadcore11:50:410
149950,0migration/015428-21sh11:15:380
149950,0migration/015166-21kthreadcore12:05:430
149950,0migration/014017-21kthreadcore09:10:420
149950,0migration/013590-21kthreadcore10:55:430
149950,0migration/010161-21kthreadcore08:00:410
149950,0migration/010061-21sh10:54:510
8305040,0irq/26-0000:00:6462-21sed10:00:242
8305040,0irq/26-0000:00:0-21swapper/212:25:252
8305040,0irq/26-0000:00:0-21swapper/209:05:392
339940,0migration/37717-21kthreadcore08:20:413
339940,0migration/327900-21kthreadcore08:35:413
339940,0migration/312946-21kthreadcore07:40:413
329940,0watchdog/331794-21munin-node08:40:353
329940,0watchdog/30-21swapper/311:50:393
329940,0watchdog/30-21swapper/311:15:433
329940,0watchdog/30-21swapper/310:50:393
329940,0watchdog/30-21swapper/307:55:433
310449943,0cyclictest3571-21lldpd08:28:062
310449943,0cyclictest3571-21lldpd07:54:052
310449943,0cyclictest3524-21snmpd08:42:522
310449943,0cyclictest3524-21snmpd08:20:062
310449943,0cyclictest3524-21snmpd08:02:362
310449943,0cyclictest3524-21snmpd07:58:212
310449943,0cyclictest3262-21awk09:40:382
310449943,0cyclictest29669-21ps09:00:412
310449943,0cyclictest27507-21sadc07:30:242
310449943,0cyclictest22172-21awk08:55:402
310449943,0cyclictest22172-21awk08:55:402
310449943,0cyclictest11010-21awk07:40:402
310449943,0cyclictest0-21swapper/209:30:412
310439944,0cyclictest0-21swapper/111:51:161
310439944,0cyclictest0-21swapper/110:50:161
310439944,0cyclictest0-21swapper/110:00:361
310439944,0cyclictest0-21swapper/109:27:201
310439943,0cyclictest6900-21awk11:10:381
310439943,0cyclictest6461-21awk11:45:401
310439943,0cyclictest3571-21lldpd10:43:071
310439943,0cyclictest3571-21lldpd08:25:361
310439943,0cyclictest3571-21lldpd08:15:361
310439943,0cyclictest3571-21lldpd07:27:061
310439943,0cyclictest30425-21awk10:30:391
310439943,0cyclictest25626-21awk08:35:391
310439943,0cyclictest25330-21awk11:20:411
310439943,0cyclictest24344-21awk12:30:401
310439943,0cyclictest21823-21awk08:10:381
310439943,0cyclictest14374-21awk07:20:391
310439943,0cyclictest11528-21awk09:10:401
310439943,0cyclictest11058-21awk07:40:401
310429944,0cyclictest0-21swapper/009:45:310
310429944,0cyclictest0-21swapper/007:30:430
310429943,0cyclictest3571-21lldpd11:25:380
310429943,0cyclictest3571-21lldpd10:08:370
310429943,0cyclictest3571-21lldpd09:22:060
310429943,0cyclictest3524-21snmpd09:51:070
310429943,0cyclictest3524-21snmpd08:22:210
310429943,0cyclictest20601-21awk09:15:380
29815040,0irq/29-eth0-tx-3534-21sshd07:45:340
29815040,0irq/29-eth0-tx-14032-21telnet08:50:370
29815040,0irq/29-eth0-tx-10163-21diskmemload10:15:342
29815040,0irq/29-eth0-tx-0-21swapper/212:15:252
29815040,0irq/29-eth0-tx-0-21swapper/212:05:252
29815040,0irq/29-eth0-tx-0-21swapper/211:35:332
29815040,0irq/29-eth0-tx-0-21swapper/211:30:312
29815040,0irq/29-eth0-tx-0-21swapper/211:20:272
29815040,0irq/29-eth0-tx-0-21swapper/210:55:272
29815040,0irq/29-eth0-tx-0-21swapper/210:45:242
29815040,0irq/29-eth0-tx-0-21swapper/210:35:422
29815040,0irq/29-eth0-tx-0-21swapper/210:30:472
29815040,0irq/29-eth0-tx-0-21swapper/209:50:242
29815040,0irq/29-eth0-tx-0-21swapper/209:35:362
29815040,0irq/29-eth0-tx-0-21swapper/209:15:402
29805040,0irq/28-eth0-rx-0-21swapper/310:55:453
29805040,0irq/28-eth0-rx-0-21swapper/310:30:353
29805040,0irq/28-eth0-rx-0-21swapper/310:15:363
29805040,0irq/28-eth0-rx-0-21swapper/310:00:453
29805040,0irq/28-eth0-rx-0-21swapper/309:55:563
29805040,0irq/28-eth0-rx-0-21swapper/307:35:433
27140,0ktimersoftd/20-21swapper/212:00:282
259940,0migration/26347-21cpuspeed_turbos07:15:352
259940,0migration/226934-21kthreadcore08:35:412
259940,0migration/226660-21kthreadcore12:30:422
259940,0migration/222148-21kthreadcore08:30:432
259940,0migration/219624-21timerandwakeup07:20:482
259940,0migration/219216-21kthreadcore08:05:412
259940,0migration/218049-21kthreadcore10:05:412
259940,0migration/21491-21fschecks_count11:25:372
249940,0watchdog/24151-21kthreadcore07:35:432
249940,0watchdog/222114-21kthreadcore10:25:392
249940,0watchdog/20-21swapper/208:50:392
249940,0watchdog/20-21swapper/208:45:432
249940,0watchdog/20-21swapper/207:10:542
179940,0migration/19260-21taskset07:36:021
179940,0migration/18423-21kthreadcore08:45:421
179940,0migration/17653-21irqcore08:00:401
179940,0migration/15272-21sh12:20:361
179940,0migration/15251-21kthreadcore12:35:421
179940,0migration/12639-21needreboot09:20:441
179940,0migration/126352-21sh09:16:061
179940,0migration/124898-21fschecks_count07:50:361
179940,0migration/123338-21switchtime07:45:481
179940,0migration/120555-21kthreadcore09:30:421
179940,0migration/117289-21latency_hist08:30:241
179940,0migration/116189-21df_abs10:05:361
179940,0migration/115495-21kthreadcore10:20:411
179940,0migration/114355-21kthreadcore12:05:431
179940,0migration/11388-21aten_r1power_en10:50:351
179940,0migration/113293-21kthreadcore10:55:421
179940,0migration/111438-21aten_r1power_cu09:45:351
169940,0watchdog/14528-21ssh11:08:191
169940,0watchdog/132350-21ssh12:00:031
169940,0watchdog/131817-21ssh10:11:031
169940,0watchdog/126349-21ssh12:12:281
169940,0watchdog/125655-21kthreadcore08:55:431
169940,0watchdog/125655-21kthreadcore08:55:431
169940,0watchdog/124984-21tr11:35:431
169940,0watchdog/10-21swapper/111:19:111
169940,0watchdog/10-21swapper/109:05:431
169940,0watchdog/10-21swapper/107:10:541
149940,0migration/03890-21timerandwakeup09:55:480
149940,0migration/029429-21forks11:05:370
8305030,0irq/26-0000:00:0-21swapper/208:10:292
329930,0watchdog/30-21swapper/308:50:393
329930,0watchdog/30-21swapper/307:20:353
310449932,0cyclictest9098-21sensors08:20:452
310449932,0cyclictest3571-21lldpd07:34:062
310439933,0cyclictest7153-21awk07:15:381
310439933,0cyclictest3571-21lldpd09:36:071
310439933,0cyclictest32536-21awk07:55:401
310439932,0cyclictest31941-21rm11:40:411
310439932,0cyclictest28786-21tune2fs09:00:371
310439932,0cyclictest14176-21grep08:50:381
310429933,0cyclictest8723-21kworker/0:107:25:270
310429933,0cyclictest8723-21kworker/0:107:15:270
310429933,0cyclictest4135-21kworker/0:212:15:380
310429933,0cyclictest4135-21kworker/0:212:00:300
310429933,0cyclictest4135-21kworker/0:211:21:060
310429933,0cyclictest4135-21kworker/0:210:30:270
310429933,0cyclictest4135-21kworker/0:210:10:370
310429933,0cyclictest4135-21kworker/0:210:00:270
310429933,0cyclictest4135-21kworker/0:209:40:390
310429933,0cyclictest4135-21kworker/0:209:30:270
310429933,0cyclictest27728-21kworker/0:008:45:250
310429933,0cyclictest27728-21kworker/0:008:35:250
310429933,0cyclictest1929-21kworker/0:112:30:360
310429933,0cyclictest1929-21kworker/0:112:20:260
29805030,0irq/28-eth0-rx-0-21swapper/308:25:383
29805030,0irq/28-eth0-rx-0-21swapper/307:45:353
169930,0watchdog/10-21swapper/107:30:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional