You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-20 - 03:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackeslot2.osadl.org (updated Wed Mar 19, 2025 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24611021000,1sleep10-21swapper/111:10:061
970172970,1sleep197021-21grep09:30:191
1943442520,2sleep30-21swapper/310:35:023
4114883992522,2cyclictest233328-21turbostat11:00:011
25010912518,2phc2sys0-21swapper/312:36:073
4114882992413,6cyclictest0-21swapper/011:05:010
25010912418,2phc2sys0-21swapper/312:26:213
25010912418,2phc2sys0-21swapper/311:15:523
25010912418,2phc2sys0-21swapper/310:35:523
25010912418,2phc2sys0-21swapper/309:26:333
25010912418,2phc2sys0-21swapper/309:15:153
25010912417,2phc2sys0-21swapper/311:54:233
25010912417,2phc2sys0-21swapper/310:45:503
25010912417,2phc2sys0-21swapper/310:13:433
25010912417,2phc2sys0-21swapper/308:10:233
25010912318,3phc2sys0-21swapper/310:51:063
25010912318,3phc2sys0-21swapper/310:22:523
25010912318,3phc2sys0-21swapper/310:22:523
25010912318,3phc2sys0-21swapper/309:48:453
25010912318,3phc2sys0-21swapper/309:22:113
25010912318,3phc2sys0-21swapper/307:32:513
25010912317,3phc2sys0-21swapper/310:40:203
25010912317,3phc2sys0-21swapper/310:19:483
25010912317,3phc2sys0-21swapper/307:40:333
25010912317,2phc2sys0-21swapper/312:33:473
25010912317,2phc2sys0-21swapper/312:24:133
25010912317,2phc2sys0-21swapper/312:01:013
25010912317,2phc2sys0-21swapper/311:48:583
25010912317,2phc2sys0-21swapper/311:09:143
25010912317,2phc2sys0-21swapper/310:56:203
25010912317,2phc2sys0-21swapper/310:26:223
25010912317,2phc2sys0-21swapper/310:06:413
25010912317,2phc2sys0-21swapper/309:55:113
25010912317,2phc2sys0-21swapper/309:54:153
25010912317,2phc2sys0-21swapper/309:33:193
25010912317,2phc2sys0-21swapper/309:12:273
25010912317,2phc2sys0-21swapper/309:02:053
25010912317,2phc2sys0-21swapper/309:02:053
25010912317,2phc2sys0-21swapper/308:08:433
25010912317,2phc2sys0-21swapper/307:56:533
25010912317,2phc2sys0-21swapper/307:48:553
25010912317,2phc2sys0-21swapper/307:26:073
25010912317,2phc2sys0-21swapper/307:24:113
25010912317,2phc2sys0-21swapper/307:15:443
25010912317,2phc2sys0-21swapper/307:13:453
4114882992214,7cyclictest0-21swapper/009:30:010
411488299220,6cyclictest71-21kcompactd012:10:010
37539722218,2sleep20-21swapper/212:34:252
36261422218,2sleep20-21swapper/212:23:472
33497322218,2sleep30-21swapper/312:07:213
32352922218,2sleep30-21swapper/311:58:553
29212322218,2sleep30-21swapper/311:36:393
25010912218,2phc2sys0-21swapper/311:44:063
25010912217,3phc2sys0-21swapper/312:17:273
25010912217,3phc2sys0-21swapper/311:34:423
25010912217,3phc2sys0-21swapper/311:20:163
25010912217,3phc2sys0-21swapper/311:10:463
25010912217,3phc2sys0-21swapper/309:41:113
25010912217,3phc2sys0-21swapper/309:39:113
25010912217,3phc2sys0-21swapper/309:07:533
25010912217,3phc2sys0-21swapper/308:27:453
25010912217,3phc2sys0-21swapper/308:15:313
25010912217,3phc2sys0-21swapper/308:03:413
25010912217,2phc2sys0-21swapper/308:52:553
25010912217,2phc2sys0-21swapper/308:41:213
25010912217,2phc2sys0-21swapper/308:20:373
9186222117,2sleep20-21swapper/209:26:082
9020822117,2sleep20-21swapper/209:24:082
7848822117,2sleep20-21swapper/209:15:302
4114884992119,1cyclictest0-21swapper/208:30:012
411488399212,9cyclictest1695-21dbus-daemon11:45:001
4114883992118,2cyclictest276460-21apt-key11:30:011
411488299219,3cyclictest172877-21kworker/u16:0-events_unbound11:49:100
411488299212,6cyclictest1695-21dbus-daemon12:15:010
4114882992113,7cyclictest205377-21kthreadcore10:40:200
4114882992110,1cyclictest191rcu_preempt10:05:390
34220822118,2sleep30-21swapper/312:10:263
33210222117,2sleep20-21swapper/212:03:232
31595922118,2sleep20-21swapper/211:55:182
29341222117,2sleep20-21swapper/211:38:502
27350222117,2sleep20-21swapper/211:25:362
26253922117,2sleep20-21swapper/211:18:222
25257822117,2sleep20-21swapper/211:11:452
25010912117,2phc2sys0-21swapper/311:01:223
25010912117,2phc2sys0-21swapper/308:30:213
25010912116,3phc2sys0-21swapper/311:28:493
2499691210,2getstats0-21swapper/308:45:193
23223122117,2sleep20-21swapper/210:58:182
22166122117,2sleep20-21swapper/210:50:292
21094922117,2sleep20-21swapper/210:43:312
20052422117,2sleep20-21swapper/210:36:142
17116122117,2sleep20-21swapper/210:17:302
16193722117,2sleep20-21swapper/210:11:572
15054922117,2sleep20-21swapper/210:03:402
11913022117,2sleep20-21swapper/209:41:352
11014622117,2sleep20-21swapper/209:36:382
924598200,4rtkit-daemon2015-21snmpd08:27:471
924598200,4rtkit-daemon120262-21packagekitd11:12:410
791222017,2sleep20-21swapper/208:16:072
6290722017,2sleep20-21swapper/209:00:472
6290722017,2sleep20-21swapper/209:00:472
5415722017,2sleep30-21swapper/308:55:273
418972422017,2sleep20-21swapper/208:05:572
417785422017,2sleep20-21swapper/207:59:002
417152422017,2sleep20-21swapper/207:50:422
415963422017,2sleep20-21swapper/207:43:132
415329122017,2sleep20-21swapper/207:38:082
414116322017,2sleep20-21swapper/207:27:302
413526122017,2sleep20-21swapper/207:24:452
412918822017,2sleep20-21swapper/207:20:012
411495022017,2sleep20-21swapper/207:10:032
4114883992018,1cyclictest0-21swapper/112:25:021
4114883992017,2cyclictest273008-21sh11:25:011
4114883992017,2cyclictest121128-21apt-key09:45:001
4114883992014,3cyclictest1696-1atopacctd09:20:021
4114883992013,3cyclictest82664-21cpuspeed_turbos09:20:191
4114882992013,6cyclictest155518-21aten_repower_po10:10:130
3932822017,2sleep20-21swapper/208:45:122
3853722017,2sleep20-21swapper/208:42:242
3247522017,2sleep20-21swapper/208:37:152
2698122017,2sleep30-21swapper/308:35:113
2653822017,2sleep20-21swapper/208:33:302
25010912017,2phc2sys0-21swapper/310:02:373
25010912017,2phc2sys0-21swapper/307:38:033
25010912017,1phc2sys0-21swapper/307:50:453
24287022017,2sleep20-21swapper/211:05:362
17388622017,2sleep20-21swapper/210:20:192
17388622017,2sleep20-21swapper/210:20:192
15191522017,2sleep20-21swapper/210:05:162
1425722017,2sleep20-21swapper/208:21:042
13589422017,2sleep20-21swapper/209:55:222
924598190,3rtkit-daemon4120973-21munin-node08:08:390
4114884991916,1cyclictest0-21swapper/210:30:012
411488399198,5cyclictest1695-21dbus-daemon07:55:011
4114883991913,5cyclictest4120999-21irqrtprio07:15:011
411488299199,6cyclictest278286-21irqrtprio11:30:190
411488299199,6cyclictest1696-1atopacctd10:00:000
4114882991916,2cyclictest76612-21kthreadcore09:15:240
4114882991916,2cyclictest57479-21sh09:00:010
4114882991916,2cyclictest1707-21polkitd12:35:010
4114882991913,5cyclictest272952-21sh11:25:010
4114882991913,5cyclictest195963-21kthreadcore10:35:230
4114882991912,6cyclictest172877-21kworker/u16:0+nfsiod11:36:550
4114882991910,5cyclictest0-21swapper/009:45:020
4114883991815,2cyclictest1696-1atopacctd08:25:011
4114883991815,2cyclictest1695-21dbus-daemon11:05:001
4114883991813,1cyclictest178850irq/121-eno112:10:011
4114882991815,2cyclictest64043-21cut09:10:000
4114882991815,2cyclictest276492-21latency_hist11:30:010
4114882991812,5cyclictest4114880-21cyclictest11:17:110
4114882991811,6cyclictest0-21swapper/012:20:010
4114882991811,4cyclictest95797-21if_enp1s0.809:30:170
4114882991811,1cyclictest601rcuop/312:28:560
4114882991811,1cyclictest601rcuop/310:33:290
411488299181,10cyclictest1-21systemd07:45:010
4114883991714,2cyclictest4179410-21irqrtprio08:00:231
4114883991714,2cyclictest4165911-21cut07:50:011
4114883991714,2cyclictest385002-21systemd-run12:40:021
4114883991714,2cyclictest1734-21rs:main1
411488299178,5cyclictest0-21swapper/009:50:140
411488299178,4cyclictest0-21swapper/012:05:020
411488299176,1cyclictest191rcu_preempt12:24:290
411488299172,4cyclictest191rcu_preempt09:20:190
411488299171,5cyclictest124326-21sshd09:49:230
4114882991714,2cyclictest4153606-21gpgconf07:40:010
4114882991714,2cyclictest1707-21polkitd10:55:010
4114882991714,2cyclictest1695-21dbus-daemon10:30:010
4114882991713,3cyclictest1726-21systemd-logind09:40:010
4114882991711,5cyclictest32724-21awk08:40:000
4114882991711,5cyclictest165200-21if_enp1s010:15:200
4114882991710,1cyclictest601rcuop/311:59:140
4114882991710,1cyclictest601rcuop/308:26:530
4114882991710,1cyclictest601rcuop/307:45:290
4114884991614,1cyclictest0-21swapper/210:50:022
4114884991613,1cyclictest0-21swapper/212:10:192
4114884991613,1cyclictest0-21swapper/208:55:002
411488399168,3cyclictest0-21swapper/109:35:321
411488399167,4cyclictest0-21swapper/110:30:161
411488399164,3cyclictest94486-21munin-run09:30:011
4114883991613,2cyclictest308861-21ssh11:50:191
4114883991613,2cyclictest277884-21gltestperf11:30:161
4114883991613,2cyclictest155449-21ssh10:10:121
4114883991613,2cyclictest134738-21grep09:55:181
4114883991612,3cyclictest172877-21kworker/u16:0+nfsiod10:21:291
4114883991612,3cyclictest172877-21kworker/u16:0+nfsiod10:21:291
411488299168,3cyclictest501rcuop/207:10:030
411488299165,6cyclictest0-21swapper/007:15:170
411488299163,2cyclictest191rcu_preempt10:05:010
4114882991613,2cyclictest376574-21cpuspeed_turbos12:35:170
4114882991613,2cyclictest295520-21if_eno111:40:210
4114882991613,2cyclictest1700-21gmain11:00:010
4114882991613,2cyclictest0-21swapper/008:50:010
4114882991612,2cyclictest4171428-21unixbench_multi07:50:320
4114882991612,1cyclictest191rcu_preempt09:04:110
4114882991612,1cyclictest191rcu_preempt09:04:100
4114882991610,2cyclictest256025-21kworker/u16:2+xprtiod11:54:110
4114882991610,1cyclictest1766601kthreadcore10:20:220
4114882991610,1cyclictest1766601kthreadcore10:20:210
411488299160,5cyclictest215429-21apt-get10:50:020
411488299160,3cyclictest0-21swapper/007:55:240
411488299160,1cyclictest0-21swapper/009:13:080
4114884991512,1cyclictest0-21swapper/211:55:002
411488399156,3cyclictest0-21swapper/110:20:021
4114883991512,2cyclictest4150089-21kthreadcore07:35:211
4114883991512,2cyclictest346693-21fschecks_count12:15:201
4114883991512,2cyclictest327591-21kthreadcore12:00:221
4114883991512,2cyclictest259187-21kthreadcore11:15:231
4114883991512,2cyclictest1726-21systemd-logind11:40:021
4114883991512,2cyclictest1695-21dbus-daemon09:05:011
4114883991512,2cyclictest1695-21dbus-daemon09:05:011
4114883991512,2cyclictest0-21swapper/110:30:011
4114883991511,3cyclictest183977-21kworker/u16:2+nfsiod10:54:381
4114883991511,3cyclictest183977-21kworker/u16:2+nfsiod10:49:401
411488399151,11cyclictest2015-21snmpd11:56:451
411488399150,14cyclictest4129215-21grep07:20:011
4114882991512,2cyclictest1700-21gmain11:10:000
4114882991512,2cyclictest1485-21threads08:10:320
4114882991511,3cyclictest4143442-21kthreadcore07:30:270
4114882991511,1cyclictest501rcuop/208:42:000
4114882991511,1cyclictest191rcu_preempt08:15:260
4114882991510,1cyclictest601rcuop/307:29:260
4114882991510,1cyclictest501rcuop/208:55:000
411488299150,5cyclictest10020-21irqrtprio08:20:230
411488499141,8cyclictest0-21swapper/209:00:012
4114884991412,1cyclictest0-21swapper/211:33:172
4114884991412,1cyclictest0-21swapper/211:05:012
4114884991411,2cyclictest0-21swapper/209:30:462
4114884991411,1cyclictest0-21swapper/212:25:162
4114884991411,1cyclictest0-21swapper/212:15:322
4114884991411,1cyclictest0-21swapper/211:20:322
4114884991411,1cyclictest0-21swapper/210:30:192
4114884991411,1cyclictest0-21swapper/207:45:232
411488399149,4cyclictest4172390-21grep07:55:171
411488399146,5cyclictest1761-21gdbus09:50:011
4114883991411,2cyclictest65139-21tail09:10:161
4114883991411,2cyclictest45267-21munin-plugin-st08:50:021
4114883991411,2cyclictest4156849-21kthreadcore07:40:261
4114883991411,2cyclictest4146511-21pmu-power07:30:311
4114883991411,2cyclictest4122551-21kworker/u16:2-events_power_efficient10:05:011
4114883991411,2cyclictest35825-21kthreadcore08:40:261
4114883991411,2cyclictest341540-21kthreadcore12:10:221
4114883991411,2cyclictest23736-21kthreadcore08:30:281
4114883991411,2cyclictest207381-21kthreadcore10:40:221
4114883991411,2cyclictest196854-21kthreadcore10:35:241
4114883991411,2cyclictest1695-21dbus-daemon12:30:011
4114883991411,2cyclictest155166-21/usr/sbin/munin10:10:021
4114883991411,2cyclictest125297-21head09:50:131
4114883991410,3cyclictest4191600-21irqrtprio08:10:251
4114882991411,2cyclictest4129668-21aten_repower_po07:20:160
4114884991311,1cyclictest0-21swapper/208:00:312
4114884991310,1cyclictest0-21swapper/212:35:482
4114884991310,1cyclictest0-21swapper/209:50:212
4114884991310,1cyclictest0-21swapper/209:50:012
4114884991310,1cyclictest0-21swapper/209:10:192
4114884991310,1cyclictest0-21swapper/209:10:012
4114884991310,1cyclictest0-21swapper/207:30:242
411488399139,3cyclictest3490-21irqcore08:15:221
411488399135,5cyclictest1761-21gdbus07:25:011
411488399133,2cyclictest306496-21awk11:50:001
411488399132,6cyclictest63973-21perf09:10:001
4114883991310,2cyclictest52733-21irqrtprio08:55:251
4114883991310,2cyclictest45969-21/usr/sbin/munin08:50:221
4114883991310,2cyclictest368013-21fschecks_count12:30:201
411488299137,1cyclictest601rcuop/308:32:370
411488299134,5cyclictest4178385-21telnet08:00:170
411488499129,1cyclictest0-21swapper/212:06:492
411488499129,1cyclictest0-21swapper/211:46:242
411488499129,1cyclictest0-21swapper/211:40:152
411488399129,2cyclictest29591-21kthreadcore08:35:221
411488399125,5cyclictest4184965-21tune2fs08:05:371
411488399121,4cyclictest1312-21hwrng11:08:311
411488299121,6cyclictest4115034-21cat07:10:020
411488499119,1cyclictest0-21swapper/208:10:202
411488499111,6cyclictest0-21swapper/207:10:012
411488399105,3cyclictest4114719-21latency_hist07:10:011
250109190,1phc2sys0-21swapper/307:08:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional