You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 00:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Thu Nov 20, 2025 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
300735321620,1sleep13007357-21kthreadcore12:30:341
25945322330,2sleep30-21swapper/308:20:003
25288182250,2sleep20-21swapper/207:25:332
302487291210,2phc2sys0-21swapper/310:54:313
2506708992118,1cyclictest0-21swapper/210:00:002
2506708992118,1cyclictest0-21swapper/208:40:012
2506707992118,2cyclictest2557791-21grep07:50:011
250670699218,2cyclictest2952092-21cut12:00:020
2506706992119,1cyclictest2908249-21grep11:35:000
2506706992119,1cyclictest2829614-21grep10:50:000
2506706992119,1cyclictest2829614-21grep10:50:000
2506706992114,6cyclictest0-21swapper/012:30:010
2506706992113,7cyclictest0-21swapper/012:10:000
835298200,4rtkit-daemon2506704-21cyclictest09:03:091
302487291200,3phc2sys0-21swapper/312:36:063
250670699203,10cyclictest2656360-21cpuspeed_turbos09:10:300
2506706992017,2cyclictest2742183-21basename10:00:000
2506706992017,2cyclictest0-21swapper/010:40:010
835298190,4rtkit-daemon2506704-21cyclictest08:34:591
302487291190,3phc2sys0-21swapper/309:55:073
2506708991916,1cyclictest0-21swapper/211:27:492
2506708991916,1cyclictest0-21swapper/210:30:002
2506708991916,1cyclictest0-21swapper/207:57:032
2506708991916,1cyclictest0-21swapper/207:15:012
2506707991916,2cyclictest2838608-21munin-run10:55:011
2506707991916,2cyclictest1629-21avahi-daemon10:45:001
2506707991914,3cyclictest2937935-21kthreadcore11:50:361
250670699198,7cyclictest2781878-21kthreadcore10:20:360
250670699198,7cyclictest2781878-21kthreadcore10:20:360
2506706991917,1cyclictest0-21swapper/008:40:010
2506706991916,2cyclictest2506704-21cyclictest10:45:010
2506706991914,3cyclictest0-21swapper/008:10:010
302487291181,4phc2sys0-21swapper/311:00:523
302487291180,2phc2sys0-21swapper/312:00:083
2506708991815,1cyclictest0-21swapper/212:20:012
2506708991815,1cyclictest0-21swapper/211:46:482
2506708991815,1cyclictest0-21swapper/211:10:272
2506708991815,1cyclictest0-21swapper/211:00:012
2506708991815,1cyclictest0-21swapper/210:40:332
2506708991815,1cyclictest0-21swapper/210:05:012
2506708991814,2cyclictest0-21swapper/211:20:012
2506707991815,2cyclictest2803614-21latency_hist10:35:011
2506707991813,4cyclictest2545716-21kworker/u16:3-rpciod10:16:271
2506706991815,2cyclictest2803218-21apt-key10:35:000
2506706991815,2cyclictest260-21systemd-journal07:50:010
2506706991814,2cyclictest0-21swapper/011:00:010
2506706991812,5cyclictest2761661-21kthreadcore10:10:370
2506706991811,6cyclictest1652-1atopacctd08:25:460
2506706991811,5cyclictest0-21swapper/010:30:010
250670699180,14cyclictest0-21swapper/011:19:270
302487291170,4phc2sys0-21swapper/309:31:473
302487291170,2phc2sys0-21swapper/311:33:263
302487291170,2phc2sys0-21swapper/311:13:143
302487291170,2phc2sys0-21swapper/311:06:443
302487291170,2phc2sys0-21swapper/309:45:423
2506708991714,1cyclictest0-21swapper/211:35:012
2506708991714,1cyclictest0-21swapper/210:40:012
2506708991714,1cyclictest0-21swapper/209:15:012
2506707991715,1cyclictest8351-21rtkit-daemon09:53:271
2506707991714,2cyclictest2882205-21latency_hist11:20:001
2506707991714,2cyclictest2864841-21gpgconf11:10:001
2506707991714,2cyclictest2691078-21cstates09:30:301
2506707991714,2cyclictest2545658-21perf07:40:001
2506707991714,2cyclictest1652-1atopacctd09:40:411
2506707991713,3cyclictest2919558-21kthreadcore11:40:341
2506707991713,3cyclictest2626738-21kthreadcore08:45:331
250670799171,10cyclictest2655447-21diskmemload12:25:011
250670699179,1cyclictest191rcu_preempt09:40:000
250670699178,5cyclictest0-21swapper/011:40:280
250670699175,7cyclictest0-21swapper/008:20:310
250670699174,1cyclictest191rcu_preempt12:00:370
250670699173,9cyclictest171ktimers/009:33:310
250670699172,9cyclictest2728284-21cut09:50:510
250670699172,10cyclictest2673396-21apt-get09:20:270
2506706991716,1cyclictest0-21swapper/010:01:280
2506706991714,2cyclictest7602-21cron11:25:000
2506706991713,2cyclictest0-21swapper/010:10:020
2506706991711,5cyclictest2655447-21diskmemload10:16:320
302487291161,2phc2sys0-21swapper/312:17:233
302487291160,3phc2sys0-21swapper/309:44:293
302487291160,2phc2sys0-21swapper/312:31:473
302487291160,2phc2sys0-21swapper/311:16:273
28693192160,2sleep02506704-21cyclictest11:10:340
2506708991614,1cyclictest0-21swapper/210:10:022
2506708991613,1cyclictest0-21swapper/211:10:002
2506708991613,1cyclictest0-21swapper/211:00:312
2506708991613,1cyclictest0-21swapper/210:25:012
2506708991613,1cyclictest0-21swapper/210:25:012
2506708991613,1cyclictest0-21swapper/209:55:002
2506708991613,1cyclictest0-21swapper/209:40:012
2506708991613,1cyclictest0-21swapper/209:30:342
2506708991613,1cyclictest0-21swapper/208:10:002
2506708991613,1cyclictest0-21swapper/207:50:022
2506708991613,1cyclictest0-21swapper/207:40:302
2506708991612,2cyclictest0-21swapper/212:30:332
2506708991612,2cyclictest0-21swapper/211:55:022
2506708991612,2cyclictest0-21swapper/208:30:292
2506708991612,2cyclictest0-21swapper/208:10:272
2506708991612,2cyclictest0-21swapper/208:10:272
250670799166,3cyclictest501rcuop/211:23:471
250670799166,3cyclictest501rcuop/211:01:551
250670799161,4cyclictest1975183-1atop10:00:011
2506707991613,2cyclictest2978131-21apt-config12:15:011
2506707991613,2cyclictest2700701-21kthreadcore09:35:321
2506707991613,2cyclictest2625112-21cut08:45:011
2506707991613,2cyclictest2526478-21pmu-power07:20:371
2506707991613,2cyclictest1700-21systemd-logind10:05:021
2506707991613,2cyclictest1700-21systemd-logind07:45:011
2506707991613,2cyclictest0-21swapper/108:40:011
2506707991612,3cyclictest2779282-21kthreadcore10:20:341
2506707991612,3cyclictest2779282-21kthreadcore10:20:341
2506707991612,3cyclictest2560043-21kthreadcore07:50:341
2506707991612,2cyclictest0-21swapper/111:40:011
250670699168,1cyclictest2836843-21ssh10:52:060
250670699167,4cyclictest2521825-21aten2.4-expect07:20:280
250670699163,7cyclictest2981499-21sort12:15:350
250670699163,7cyclictest2607041-21aten2.4-expect08:30:280
250670699163,4cyclictest0-21swapper/009:27:540
250670699162,6cyclictest2917163-21kworker/u16:3+rpciod12:33:580
2506706991613,2cyclictest7602-21cron09:00:000
2506706991613,2cyclictest2594641-21munin-plugin-st08:20:010
2506706991613,2cyclictest2570388-21aten2.4-expect08:00:290
2506706991613,2cyclictest2570009-21latency_hist08:00:010
2506706991613,1cyclictest0-21swapper/007:15:010
2506706991611,1cyclictest26287862cut08:45:340
2506706991610,2cyclictest170550irq/121-eno112:20:330
250670699160,6cyclictest2935899-21expr11:50:330
250670699160,4cyclictest1975183-1atop07:20:010
302487291151,4phc2sys0-21swapper/311:41:533
302487291150,3phc2sys0-21swapper/310:26:143
302487291150,2phc2sys0-21swapper/312:25:583
302487291150,2phc2sys0-21swapper/311:23:133
302487291150,2phc2sys0-21swapper/309:11:003
2506708991512,1cyclictest0-21swapper/212:25:282
2506708991512,1cyclictest0-21swapper/212:15:012
2506708991512,1cyclictest0-21swapper/212:02:432
2506708991512,1cyclictest0-21swapper/210:50:352
2506708991512,1cyclictest0-21swapper/210:47:252
2506708991512,1cyclictest0-21swapper/210:47:252
2506708991512,1cyclictest0-21swapper/210:34:442
2506708991512,1cyclictest0-21swapper/208:00:382
2506708991512,1cyclictest0-21swapper/207:30:342
2506708991511,2cyclictest0-21swapper/212:06:572
2506708991511,2cyclictest0-21swapper/211:20:372
250670799158,1cyclictest601rcuop/310:49:171
250670799158,1cyclictest601rcuop/310:49:171
250670799157,3cyclictest501rcuop/212:03:111
250670799156,3cyclictest501rcuop/211:32:411
250670799156,3cyclictest501rcuop/211:29:161
250670799156,3cyclictest501rcuop/210:13:181
250670799156,3cyclictest501rcuop/209:16:351
250670799156,3cyclictest501rcuop/208:23:051
250670799156,3cyclictest501rcuop/208:15:511
250670799156,3cyclictest501rcuop/207:19:491
250670799151,3cyclictest2756379-21grep10:05:371
2506707991512,2cyclictest2917163-21kworker/u16:3-rpciod12:28:221
2506707991512,2cyclictest2839427-21tr10:55:301
2506707991512,2cyclictest2721451-21latency09:45:391
2506707991512,2cyclictest2690320-21systemd-run09:30:021
2506707991512,2cyclictest2643348-21sh09:00:001
2506707991512,2cyclictest2568909-21head07:55:351
2506707991512,2cyclictest2506704-21cyclictest10:25:371
2506707991512,2cyclictest0-21swapper/108:10:001
2506707991511,3cyclictest2947621-21kthreadcore11:55:331
2506707991511,3cyclictest2931170-21kthreadcore11:45:391
2506707991510,1cyclictest26523501kthreadcore09:05:321
250670699157,4cyclictest2821511-21kworker/u16:1+xprtiod11:00:070
250670699154,2cyclictest2910066-21if_enp1s0.811:36:110
250670699153,7cyclictest2708056-21diskmemload09:40:280
250670699153,7cyclictest2334786-21kworker/u16:0+rpciod11:25:310
250670699151,9cyclictest2716870-21aten2.4-expect09:45:310
250670699151,8cyclictest2631596-21aten2.4-expect08:50:290
2506706991513,1cyclictest2533553-21systemd-run07:30:000
2506706991512,2cyclictest3018221-21needreboot12:35:370
2506706991512,2cyclictest2667587-21tr09:15:360
2506706991512,2cyclictest2619930-21fschecks_count08:40:280
2506706991512,2cyclictest2534095-21cpuspeed_turbos07:30:290
2506706991512,2cyclictest0-21swapper/009:05:020
2506706991511,3cyclictest2917163-21kworker/u16:3+nfsiod12:10:070
302487291140,5phc2sys0-21swapper/309:27:583
302487291140,2phc2sys0-21swapper/312:21:163
302487291140,2phc2sys0-21swapper/310:30:313
302487291140,2phc2sys0-21swapper/309:23:073
250670899149,3cyclictest2601894-21chrt08:25:522
2506708991412,1cyclictest0-21swapper/208:40:272
2506708991411,1cyclictest0-21swapper/211:36:132
2506708991411,1cyclictest0-21swapper/210:15:362
2506708991411,1cyclictest0-21swapper/209:25:352
2506708991411,1cyclictest0-21swapper/209:20:292
2506708991411,1cyclictest0-21swapper/209:17:262
2506708991411,1cyclictest0-21swapper/208:55:012
2506708991411,1cyclictest0-21swapper/208:45:302
2506708991410,2cyclictest0-21swapper/212:21:562
2506708991410,2cyclictest0-21swapper/208:20:322
250670799149,4cyclictest1652-1atopacctd10:35:361
250670799149,3cyclictest2527901-21aten2.4-expect07:25:291
250670799146,3cyclictest501rcuop/209:20:111
250670799145,3cyclictest501rcuop/212:15:451
250670799145,3cyclictest501rcuop/209:11:091
250670799145,3cyclictest501rcuop/208:25:411
2506707991411,2cyclictest2961205-21tail12:05:281
2506707991411,2cyclictest2583238-21/usr/sbin/munin08:10:311
2506707991411,2cyclictest2583238-21/usr/sbin/munin08:10:311
2506707991411,2cyclictest2538004-21kthreadcore07:30:351
2506707991411,2cyclictest2506823-21sh07:10:021
2506707991410,3cyclictest3014709-21kthreadcore12:35:351
2506707991410,3cyclictest2508278-21kthreadcore07:10:361
250670699147,1cyclictest170550irq/121-eno109:05:260
250670699141,8cyclictest2586611-21kthreadcore08:10:350
250670699141,8cyclictest2586611-21kthreadcore08:10:350
2506706991411,2cyclictest2928835-21kthreadcore11:45:370
2506706991411,2cyclictest2563173-21switchtime07:50:390
2506706991411,2cyclictest2547283-21kthreadcore07:40:350
2506706991411,2cyclictest2541545-21kthreadcore07:35:340
2506706991411,2cyclictest2506704-21cyclictest11:05:200
2506706991411,2cyclictest0-21swapper/007:10:010
302487291130,2phc2sys0-21swapper/311:38:273
302487291130,2phc2sys0-21swapper/310:57:153
302487291130,2phc2sys0-21swapper/309:54:083
2506708991311,1cyclictest0-21swapper/212:35:352
2506708991311,1cyclictest0-21swapper/211:55:302
2506708991311,1cyclictest0-21swapper/210:10:292
2506708991311,1cyclictest0-21swapper/209:44:222
2506708991311,1cyclictest0-21swapper/207:50:342
2506708991311,1cyclictest0-21swapper/207:15:312
2506708991310,1cyclictest0-21swapper/209:45:322
2506708991310,1cyclictest0-21swapper/209:05:322
2506708991310,1cyclictest0-21swapper/208:55:512
250670799138,3cyclictest260-21systemd-journal11:10:021
250670799135,3cyclictest501rcuop/208:00:241
2506707991310,2cyclictest2632664-21irqrtprio08:50:341
302487291124,3phc2sys0-21swapper/310:15:013
302487291122,3phc2sys0-21swapper/312:11:223
302487291120,3phc2sys0-21swapper/308:45:263
302487291120,3phc2sys0-21swapper/308:00:023
302487291120,2phc2sys0-21swapper/311:58:373
302487291120,2phc2sys0-21swapper/310:40:283
302487291120,2phc2sys0-21swapper/310:23:533
302487291120,2phc2sys0-21swapper/310:23:533
302487291120,2phc2sys0-21swapper/309:02:583
302487291120,2phc2sys0-21swapper/308:34:003
302487291120,2phc2sys0-21swapper/308:20:293
302487291120,2phc2sys0-21swapper/308:04:103
250670899129,1cyclictest0-21swapper/207:20:342
2506708991210,1cyclictest0-21swapper/211:40:362
2506708991210,1cyclictest0-21swapper/209:05:002
2506708991210,1cyclictest0-21swapper/208:15:372
2506708991210,1cyclictest0-21swapper/207:40:022
2506708991210,1cyclictest0-21swapper/207:10:012
302487291112,2phc2sys0-21swapper/310:07:383
302487291112,2phc2sys0-21swapper/307:20:393
302487291111,5phc2sys0-21swapper/312:05:273
302487291110,3phc2sys0-21swapper/309:40:013
302487291110,2phc2sys0-21swapper/307:44:593
302487291110,2phc2sys0-21swapper/307:06:363
302487291110,1phc2sys0-21swapper/307:48:283
27492422110,2sleep30-21swapper/310:02:203
302487291102,2phc2sys0-21swapper/311:47:103
302487291101,3phc2sys0-21swapper/308:10:273
302487291101,3phc2sys0-21swapper/308:10:273
302487291101,3phc2sys0-21swapper/307:35:293
302487291101,2phc2sys0-21swapper/310:35:113
302487291101,2phc2sys0-21swapper/310:15:363
302487291101,2phc2sys0-21swapper/309:15:363
302487291101,2phc2sys0-21swapper/308:50:353
302487291100,3phc2sys0-21swapper/307:10:293
302487291100,2phc2sys0-21swapper/311:51:193
302487291100,2phc2sys0-21swapper/311:25:413
302487291100,2phc2sys0-21swapper/310:45:533
302487291100,2phc2sys0-21swapper/310:45:533
302487291100,2phc2sys0-21swapper/307:30:403
302487291100,2phc2sys0-21swapper/307:29:203
30248729191,3phc2sys0-21swapper/308:40:323
30248729191,2phc2sys0-21swapper/308:25:423
30248729190,2phc2sys0-21swapper/309:06:033
30248729190,2phc2sys0-21swapper/308:55:523
30248729190,2phc2sys0-21swapper/308:35:323
30248729190,2phc2sys0-21swapper/307:15:143
2576293290,5sleep30-21swapper/308:05:263
30248729180,2phc2sys0-21swapper/307:50:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional