You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 07:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Sat Nov 22, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170289021170,2sleep01702862-21cron23:35:010
13097312800,2sleep30-21swapper/319:15:023
16165522370,2sleep11616546-21apt-get22:45:281
15695762330,1sleep10-21swapper/122:15:381
1302026993019,7cyclictest1540506-21kthreadcore22:00:330
16648362240,2sleep30-21swapper/323:10:393
1302026992311,7cyclictest0-21swapper/023:05:010
1302026992214,4cyclictest1756234-21fschecks_time00:05:290
130202799219,4cyclictest191rcu_preempt00:22:081
1302026992118,2cyclictest1451361-21systemd-run21:10:020
130202699210,16cyclictest1486211-21/usr/sbin/munin21:30:290
130202699210,16cyclictest1486211-21/usr/sbin/munin21:30:290
130202899202,11cyclictest0-21swapper/200:10:012
1302026992017,2cyclictest1520440-21/usr/sbin/munin21:50:010
1302026992017,2cyclictest1459676-21grep21:15:010
302487291190,3phc2sys0-21swapper/323:18:573
302487291190,2phc2sys0-21swapper/321:10:453
1302028991916,1cyclictest0-21swapper/221:00:012
1302027991911,3cyclictest0-21swapper/123:00:011
130202699198,6cyclictest0-21swapper/023:35:300
130202699197,8cyclictest1743502-21ssh23:55:370
1302026991918,1cyclictest0-21swapper/020:01:540
1302026991916,2cyclictest260-21systemd-journal20:25:000
1302026991916,2cyclictest1438865-21systemd21:00:000
1302026991911,6cyclictest0-21swapper/021:55:020
835298180,4rtkit-daemon1308244-21munin-node20:42:280
1302028991816,1cyclictest0-21swapper/223:45:282
1302028991816,1cyclictest0-21swapper/223:40:022
1302028991816,1cyclictest0-21swapper/223:30:012
1302028991815,1cyclictest0-21swapper/223:25:002
1302028991815,1cyclictest0-21swapper/223:00:382
1302028991815,1cyclictest0-21swapper/221:35:312
1302028991815,1cyclictest0-21swapper/200:40:002
1302028991815,1cyclictest0-21swapper/200:29:442
1302027991815,2cyclictest1439026-21apt-config21:00:011
1302027991815,2cyclictest0-21swapper/100:30:001
130202699187,7cyclictest1471533-21kthreadcore21:20:340
130202699186,8cyclictest1712528-21cstates23:40:300
1302026991815,2cyclictest8351-21rtkit-daemon00:36:390
1302026991815,2cyclictest1359677-21systemd19:55:010
1302026991815,2cyclictest1359677-21systemd19:55:010
1302026991810,7cyclictest1631-21gmain00:30:020
1302026991810,4cyclictest1781027-21cron00:24:560
1302028991715,1cyclictest0-21swapper/221:20:012
1302028991714,1cyclictest0-21swapper/223:17:212
1302028991714,1cyclictest0-21swapper/222:25:002
1302028991714,1cyclictest0-21swapper/200:20:382
1302028991714,1cyclictest0-21swapper/200:00:012
1302028991713,2cyclictest0-21swapper/222:50:422
130202799179,3cyclictest1335330-21head19:35:251
130202799179,3cyclictest0-21swapper/123:25:011
130202799179,2cyclictest1420518-21turbostat.cron20:49:551
130202799178,4cyclictest1353483-21/usr/sbin/munin19:50:321
130202799178,4cyclictest1353483-21/usr/sbin/munin19:50:321
130202799178,4cyclictest0-21swapper/119:35:021
130202799172,3cyclictest0-21swapper/121:15:271
1302027991714,2cyclictest1648928-21runrttasks23:02:031
1302027991713,3cyclictest1310237-21kthreadcore19:15:031
1302027991713,3cyclictest1-21systemd21:56:411
1302027991713,1cyclictest191rcu_preempt23:11:331
130202799171,1cyclictest1389957-21munin-plugin-st20:20:001
1302027991710,4cyclictest601rcuop/323:31:391
1302027991710,3cyclictest1749762-21kthreadcore00:00:331
130202799170,7cyclictest1728907-21kworker/1:0+events23:59:121
130202699178,5cyclictest0-21swapper/000:20:020
130202699176,4cyclictest0-21swapper/022:15:250
130202699175,7cyclictest0-21swapper/020:15:330
130202699175,4cyclictest1694652-21kworker/u16:3-rpciod00:15:020
1302026991714,2cyclictest1511776-21systemd21:45:010
1302026991714,2cyclictest1403139-21cut20:30:290
1302026991714,2cyclictest1308461-21wc19:15:010
1302026991714,2cyclictest1302024-21cyclictest23:25:360
302487291161,4phc2sys0-21swapper/319:30:273
302487291160,3phc2sys0-21swapper/322:53:203
302487291160,2phc2sys0-21swapper/322:00:503
302487291160,2phc2sys0-21swapper/321:56:333
130202899166,5cyclictest0-21swapper/223:10:012
1302028991614,1cyclictest0-21swapper/222:30:002
1302028991613,1cyclictest0-21swapper/223:30:252
1302028991613,1cyclictest0-21swapper/223:00:002
1302028991613,1cyclictest0-21swapper/222:40:012
1302028991613,1cyclictest0-21swapper/222:10:322
1302028991613,1cyclictest0-21swapper/220:50:002
1302028991613,1cyclictest0-21swapper/219:30:012
1302028991613,1cyclictest0-21swapper/200:13:112
1302028991612,2cyclictest0-21swapper/221:22:202
130202799169,1cyclictest601rcuop/321:51:521
130202799168,4cyclictest1451140-21diskmemload00:31:591
130202799167,3cyclictest501rcuop/221:21:341
130202799166,4cyclictest0-21swapper/121:10:261
1302027991614,1cyclictest1511759-21cut21:45:011
1302027991613,2cyclictest2025-21snmpd22:25:321
1302027991613,2cyclictest1661-21polkitd23:35:371
1302027991613,2cyclictest1600018-21grep22:35:321
1302027991613,2cyclictest1580873-21cron22:25:001
1302027991613,2cyclictest1365562-21idleruntime-cro20:00:001
1302027991613,2cyclictest1365562-21idleruntime-cro20:00:001
1302027991612,3cyclictest1652-1atopacctd20:35:351
1302027991612,3cyclictest1607235-21kworker/u16:0+nfsiod23:05:331
1302027991612,3cyclictest1345327-21kthreadcore19:40:371
1302027991612,3cyclictest1183030-21kworker/u16:3+nfsiod22:08:451
130202799161,14cyclictest1512192-21apt-get21:45:241
1302027991611,2cyclictest601rcuop/300:08:151
130202699167,5cyclictest1420939-21tail20:45:270
130202699166,5cyclictest1529561-21apt-get21:55:280
130202699165,6cyclictest0-21swapper/022:15:010
130202699164,7cyclictest1614054-21diskmemload22:42:180
130202699161,4cyclictest1728885-21munin-run23:50:000
1302026991614,1cyclictest8351-21rtkit-daemon19:15:510
1302026991613,2cyclictest1656363-21mailstats23:05:360
1302026991613,2cyclictest1624618-21awk22:50:010
1302026991613,2cyclictest1582572-21irqcore22:25:320
1302026991612,3cyclictest1589695-21kworker/u16:2+nfsiod22:37:090
1302026991612,3cyclictest1459773-21kworker/u16:2+nfsiod21:28:010
1302026991612,3cyclictest1459773-21kworker/u16:2+nfsiod21:28:010
302487291151,4phc2sys0-21swapper/323:35:253
302487291150,2phc2sys0-21swapper/322:36:143
15633622150,2sleep30-21swapper/322:14:363
130202899159,4cyclictest1367260-21chrt20:00:342
130202899151,5cyclictest0-21swapper/220:30:012
130202899151,3cyclictest0-21swapper/222:20:012
1302028991512,2cyclictest0-21swapper/220:40:022
1302028991512,1cyclictest0-21swapper/221:40:312
1302028991512,1cyclictest0-21swapper/221:10:282
1302028991512,1cyclictest0-21swapper/220:30:302
1302028991512,1cyclictest0-21swapper/219:25:002
130202899151,1cyclictest0-21swapper/220:10:002
1302028991511,2cyclictest0-21swapper/222:45:282
1302028991511,2cyclictest0-21swapper/200:00:272
130202799159,1cyclictest601rcuop/322:30:111
130202799158,4cyclictest1311057-21aten2.4-expect19:15:271
130202799157,3cyclictest501rcuop/223:54:591
130202799157,3cyclictest501rcuop/223:49:101
130202799157,3cyclictest501rcuop/222:52:351
130202799157,3cyclictest501rcuop/220:40:341
130202799157,3cyclictest501rcuop/200:17:521
130202799157,3cyclictest501rcuop/200:14:071
130202799156,3cyclictest501rcuop/222:03:181
130202799156,3cyclictest501rcuop/221:30:431
130202799156,3cyclictest501rcuop/221:30:431
130202799156,3cyclictest501rcuop/220:12:291
130202799151,3cyclictest0-21swapper/121:35:261
1302027991512,2cyclictest1694401-21latency_hist23:30:021
1302027991512,2cyclictest1318209-21grep19:20:331
1302027991512,2cyclictest1302024-21cyclictest21:00:331
1302027991510,1cyclictest601rcuop/320:55:021
1302027991510,1cyclictest170550irq/121-eno121:25:271
1302027991510,1cyclictest170550irq/121-eno121:25:271
130202699159,5cyclictest1302024-21cyclictest23:20:260
130202699156,2cyclictest0-21swapper/022:55:250
1302026991512,2cyclictest8351-21rtkit-daemon00:02:500
1302026991512,2cyclictest1661228-21irqrtprio23:10:360
1302026991512,2cyclictest1555196-21kworker/u16:0+events_unbound22:25:010
1302026991512,2cyclictest1546997-21aten_repower_fr22:05:260
1302026991511,3cyclictest1800079-21irqcore00:30:320
1302026991511,3cyclictest1495561-21fschecks_time21:35:310
1302026991510,4cyclictest1302024-21cyclictest22:51:280
130202699150,9cyclictest1590996-21ssh22:30:300
302487291140,4phc2sys0-21swapper/320:55:003
302487291140,4phc2sys0-21swapper/300:15:403
302487291140,3phc2sys0-21swapper/322:27:053
302487291140,2phc2sys0-21swapper/323:31:373
302487291140,2phc2sys0-21swapper/322:46:553
302487291140,2phc2sys0-21swapper/321:16:413
302487291140,2phc2sys0-21swapper/300:11:433
302487291140,2phc2sys0-21swapper/300:00:583
130202899143,5cyclictest0-21swapper/221:45:242
130202899142,6cyclictest0-21swapper/222:10:012
1302028991412,1cyclictest0-21swapper/223:55:022
1302028991412,1cyclictest0-21swapper/223:45:002
1302028991412,1cyclictest0-21swapper/222:40:332
1302028991412,1cyclictest0-21swapper/222:35:022
1302028991412,1cyclictest0-21swapper/220:45:012
1302028991411,1cyclictest0-21swapper/222:00:352
1302028991411,1cyclictest0-21swapper/221:05:382
1302028991411,1cyclictest0-21swapper/220:10:312
1302028991411,1cyclictest0-21swapper/219:55:262
1302028991411,1cyclictest0-21swapper/219:55:262
1302028991411,1cyclictest0-21swapper/219:55:002
1302028991411,1cyclictest0-21swapper/219:55:002
1302028991411,1cyclictest0-21swapper/219:15:332
1302028991411,1cyclictest0-21swapper/219:15:002
1302028991410,2cyclictest0-21swapper/219:35:352
130202799149,1cyclictest191rcu_preempt00:38:221
130202799148,5cyclictest1327170-21tr19:25:351
130202799146,3cyclictest501rcuop/220:25:431
130202799146,3cyclictest501rcuop/220:03:351
130202799143,6cyclictest1685641-21kworker/u16:2+xprtiod23:41:511
1302027991411,2cyclictest1608516-21sed22:40:321
1302027991411,2cyclictest1403534-21irqrtprio20:30:311
1302027991411,2cyclictest1390994-21gltestperf20:20:321
1302027991411,2cyclictest0-21swapper/119:10:011
1302027991410,3cyclictest1348586-21irqrtprio19:45:301
1302027991410,1cyclictest601rcuop/323:19:041
130202799140,13cyclictest0-21swapper/121:05:251
130202699147,3cyclictest0-21swapper/021:15:420
130202699145,8cyclictest1672008-21tr23:15:320
130202699145,5cyclictest0-21swapper/020:27:530
130202699145,4cyclictest1347674-21tr19:45:260
1302026991411,2cyclictest1652-1atopacctd19:25:010
1302026991411,2cyclictest1635-21dbus-daemon23:55:010
1302026991411,2cyclictest1444140-21phc2sys-jitter21:00:350
1302026991411,2cyclictest1378450-21cstates20:10:250
1302026991411,2cyclictest1360916-21sed19:55:310
1302026991411,2cyclictest1360916-21sed19:55:310
1302026991411,2cyclictest1346373-21mailstats19:40:410
1302026991411,2cyclictest1336564-21kthreadcore19:35:310
1302026991411,2cyclictest0-21swapper/019:35:010
835298130,4rtkit-daemon1411005-21cat20:35:350
302487291133,2phc2sys0-21swapper/300:24:103
302487291132,3phc2sys0-21swapper/322:20:553
302487291130,2phc2sys0-21swapper/323:22:413
302487291130,2phc2sys0-21swapper/323:08:483
302487291130,2phc2sys0-21swapper/323:02:563
302487291130,2phc2sys0-21swapper/322:41:433
302487291130,2phc2sys0-21swapper/322:30:133
302487291130,2phc2sys0-21swapper/321:28:173
302487291130,2phc2sys0-21swapper/321:28:173
302487291130,2phc2sys0-21swapper/321:00:313
302487291130,2phc2sys0-21swapper/320:59:553
302487291130,2phc2sys0-21swapper/300:05:523
130202899139,2cyclictest0-21swapper/221:53:592
130202899131,5cyclictest0-21swapper/219:10:012
1302028991311,1cyclictest0-21swapper/219:30:272
1302028991310,1cyclictest0-21swapper/221:55:322
1302028991310,1cyclictest0-21swapper/221:25:262
1302028991310,1cyclictest0-21swapper/221:25:262
1302028991310,1cyclictest0-21swapper/221:00:332
1302028991310,1cyclictest0-21swapper/220:15:292
1302028991310,1cyclictest0-21swapper/219:45:322
1302028991310,1cyclictest0-21swapper/200:30:322
1302028991310,1cyclictest0-21swapper/200:15:292
1302027991310,2cyclictest1373097-21irqrtprio20:05:321
1302027991310,2cyclictest1302024-21cyclictest22:10:241
130202699137,5cyclictest1323408-21cpuspeed_turbos19:25:290
1302026991310,2cyclictest1377841-21latency_hist20:10:010
1302026991310,2cyclictest0-21swapper/019:10:000
130202699130,8cyclictest1427491-21diskstats20:50:270
302487291123,2phc2sys0-21swapper/321:53:373
302487291120,3phc2sys0-21swapper/323:48:113
302487291120,2phc2sys0-21swapper/320:16:313
302487291120,2phc2sys0-21swapper/300:30:433
302487291120,2phc2sys0-21swapper/300:29:073
130202899129,1cyclictest0-21swapper/220:20:342
1302028991210,1cyclictest0-21swapper/223:10:322
1302028991210,1cyclictest0-21swapper/220:50:262
302487291112,2phc2sys0-21swapper/323:51:403
302487291112,2phc2sys0-21swapper/320:05:333
302487291112,2phc2sys0-21swapper/319:20:333
302487291111,4phc2sys0-21swapper/321:20:263
302487291111,3phc2sys0-21swapper/319:45:343
302487291111,2phc2sys0-21swapper/323:25:353
302487291110,3phc2sys0-21swapper/321:05:323
302487291110,2phc2sys0-21swapper/321:32:133
302487291110,2phc2sys0-21swapper/321:32:133
302487291110,2phc2sys0-21swapper/320:02:043
302487291110,2phc2sys0-21swapper/319:19:493
302487291110,1phc2sys0-21swapper/319:42:293
302487291110,1phc2sys0-21swapper/319:36:363
130202899119,1cyclictest0-21swapper/221:30:332
130202899119,1cyclictest0-21swapper/221:30:332
130202899119,1cyclictest0-21swapper/219:40:362
302487291103,3phc2sys0-21swapper/320:10:453
302487291101,2phc2sys0-21swapper/322:56:023
302487291101,2phc2sys0-21swapper/322:06:163
302487291101,2phc2sys0-21swapper/319:05:263
302487291100,4phc2sys0-21swapper/320:30:253
302487291100,3phc2sys0-21swapper/300:35:363
302487291100,2phc2sys0-21swapper/323:56:453
302487291100,2phc2sys0-21swapper/323:40:543
302487291100,2phc2sys0-21swapper/321:40:063
302487291100,2phc2sys0-21swapper/320:50:013
302487291100,2phc2sys0-21swapper/320:20:283
302487291100,2phc2sys0-21swapper/319:55:393
302487291100,2phc2sys0-21swapper/319:55:393
30248729191,2phc2sys0-21swapper/321:45:143
30248729190,3phc2sys0-21swapper/320:40:013
30248729190,2phc2sys0-21swapper/322:15:023
30248729190,2phc2sys0-21swapper/321:35:503
30248729190,2phc2sys0-21swapper/320:40:233
30248729190,2phc2sys0-21swapper/320:25:253
30248729190,2phc2sys0-21swapper/319:50:263
30248729190,2phc2sys0-21swapper/319:50:263
30248729190,2phc2sys0-21swapper/319:25:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional