You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 16:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Tue Dec 02, 2025 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
214292208176,21sleep10-21swapper/107:09:141
213042200163,24sleep00-21swapper/007:07:360
211852199159,27sleep20-21swapper/207:06:052
212382197161,23sleep30-21swapper/307:06:463
114222750,0sleep10-21swapper/112:05:151
93392600,0sleep30-21swapper/310:30:163
41402180,1sleep24060-21ssh12:40:002
2157699170,1cyclictest0-21swapper/109:30:451
269722140,0sleep00-21swapper/010:10:150
2157699130,1cyclictest0-21swapper/112:35:171
2157699130,1cyclictest0-21swapper/112:15:121
2157699130,1cyclictest0-21swapper/109:00:221
2157699130,1cyclictest0-21swapper/107:20:151
98262120,0sleep20-21swapper/209:45:162
21589991210,1cyclictest35-21ksoftirqd/308:20:003
2157699120,1cyclictest0-21swapper/110:25:341
2157699120,1cyclictest0-21swapper/107:15:171
2157699120,0cyclictest0-21swapper/112:00:321
2157699120,0cyclictest0-21swapper/111:16:071
286782110,0sleep10-21swapper/109:28:191
2158099110,7cyclictest23935-21munin-node10:05:322
2157699110,2cyclictest0-21swapper/111:48:351
2157699110,2cyclictest0-21swapper/110:44:051
2157699110,2cyclictest0-21swapper/110:03:121
2157699110,11cyclictest0-21swapper/109:21:201
2157699110,10cyclictest0-21swapper/112:29:421
2157699110,10cyclictest0-21swapper/111:05:161
2157699110,10cyclictest0-21swapper/110:47:221
2157699110,1cyclictest0-21swapper/111:35:181
2157699110,1cyclictest0-21swapper/111:30:441
2157699110,1cyclictest0-21swapper/111:10:011
2157699110,1cyclictest0-21swapper/111:00:211
2157699110,1cyclictest0-21swapper/110:11:011
2157699110,1cyclictest0-21swapper/110:08:441
2157699110,1cyclictest0-21swapper/109:45:041
2157699110,1cyclictest0-21swapper/108:55:191
2157699110,1cyclictest0-21swapper/108:20:141
2157699110,0cyclictest0-21swapper/112:21:031
2157699110,0cyclictest0-21swapper/110:57:181
2157699110,0cyclictest0-21swapper/110:53:391
2157699110,0cyclictest0-21swapper/110:18:481
2157699110,0cyclictest0-21swapper/109:58:291
2157699110,0cyclictest0-21swapper/109:14:291
2156899113,4cyclictest11096-21munin-run12:05:000
2156899110,7cyclictest1293-21/usr/sbin/munin10:20:160
21580991010,0cyclictest14491-21diskmemload12:09:002
2157699102,1cyclictest0-21swapper/112:34:081
2157699101,1cyclictest0-21swapper/111:57:221
2157699100,9cyclictest0-21swapper/110:23:401
2157699100,2cyclictest0-21swapper/110:33:491
2157699100,1cyclictest0-21swapper/112:10:581
2157699100,1cyclictest0-21swapper/111:25:151
2157699100,1cyclictest0-21swapper/111:21:281
2157699100,1cyclictest0-21swapper/110:37:221
2157699100,1cyclictest0-21swapper/109:50:201
2157699100,1cyclictest0-21swapper/109:40:011
2157699100,1cyclictest0-21swapper/109:36:011
2157699100,0cyclictest0-21swapper/111:50:221
2157699100,0cyclictest0-21swapper/111:41:111
2156899108,1cyclictest9-21ksoftirqd/011:45:190
2156899105,3cyclictest18777-21cron10:45:000
212892100,1sleep09-21ksoftirqd/010:00:290
215899997,1cyclictest35-21ksoftirqd/308:40:003
215899991,7cyclictest23935-21munin-node09:00:573
215899991,5cyclictest14491-21diskmemload09:55:113
215809998,1cyclictest28-21ksoftirqd/211:14:312
215809990,7cyclictest0-21swapper/210:20:022
215769999,0cyclictest0-21swapper/108:02:281
215769990,8cyclictest0-21swapper/108:50:121
215769990,1cyclictest0-21swapper/109:19:421
215769990,1cyclictest0-21swapper/109:05:141
215769990,1cyclictest0-21swapper/108:25:121
215769990,1cyclictest0-21swapper/107:35:171
215689990,8cyclictest0-21swapper/009:55:570
215689990,7cyclictest0-21swapper/011:34:050
215689990,3cyclictest11353-21ssh10:34:070
215689990,3cyclictest0-21swapper/008:00:110
215899987,1cyclictest35-21ksoftirqd/307:35:013
215899987,0cyclictest35-21ksoftirqd/310:56:513
215899986,1cyclictest35-21ksoftirqd/308:35:013
215899986,1cyclictest0-21swapper/309:43:243
215899982,3cyclictest11510-21apt-get07:55:183
215899981,4cyclictest0-21swapper/311:15:143
215809987,1cyclictest28-21ksoftirqd/208:45:002
215809986,1cyclictest60950irq/123-eno108:30:112
215809984,2cyclictest254-21systemd-journal10:45:002
215809981,4cyclictest60950irq/123-eno109:55:102
215809980,6cyclictest554-21in:imuxsock10:02:032
215809980,5cyclictest570-21systemd-logind07:55:252
215809980,1cyclictest0-21swapper/208:25:122
215769980,5cyclictest0-21swapper/108:36:131
215769980,0cyclictest0-21swapper/107:30:191
215689987,1cyclictest29294-21perf09:29:590
215689985,0cyclictest14491-21diskmemload11:54:490
215689981,6cyclictest18334-21/usr/sbin/munin09:15:160
215689981,2cyclictest22309-21/usr/sbin/munin12:20:230
215689981,2cyclictest15285-21apt-get11:25:110
215689981,1cyclictest29595-21/usr/sbin/munin09:30:350
215689980,4cyclictest4191-21apt-get11:55:130
215689980,4cyclictest0-21swapper/012:25:130
215689980,3cyclictest0-21swapper/011:41:040
215689980,1cyclictest0-21swapper/011:20:230
215689980,0cyclictest0-21swapper/007:35:140
24962270,0sleep00-21swapper/010:05:510
215899976,1cyclictest14491-21diskmemload12:09:183
215899975,1cyclictest7338-21ssh11:13:563
215899974,1cyclictest35-21ksoftirqd/308:21:313
215899974,1cyclictest14491-21diskmemload10:10:143
215899973,1cyclictest14491-21diskmemload09:15:173
215899972,5cyclictest23937-21kworker/3:109:12:083
215899972,4cyclictest14491-21diskmemload11:45:143
215899972,2cyclictest14491-21diskmemload11:39:383
215899971,4cyclictest0-21swapper/311:23:123
215899971,3cyclictest22607-21apt-get10:50:123
215899971,3cyclictest14491-21diskmemload11:05:133
215899970,6cyclictest9299-21ssh09:45:143
215899970,4cyclictest14491-21diskmemload10:20:143
215899970,4cyclictest0-21swapper/310:40:123
215899970,3cyclictest29612-21hostname09:30:123
215899970,1cyclictest0-21swapper/308:55:143
215809976,1cyclictest6290-21ntpq09:40:192
215809976,1cyclictest60950irq/123-eno112:22:562
215809976,1cyclictest60950irq/123-eno111:55:132
215809976,1cyclictest60950irq/123-eno110:49:212
215809976,1cyclictest60950irq/123-eno109:20:222
215809976,1cyclictest5401-21ntpq07:40:182
215809976,1cyclictest3406-21ssh09:36:412
215809976,1cyclictest28-21ksoftirqd/208:45:142
215809976,1cyclictest28-21ksoftirqd/207:15:012
215809976,1cyclictest19886-21ntpq12:15:182
215809976,0cyclictest60950irq/123-eno111:05:142
215809976,0cyclictest60950irq/123-eno110:55:182
215809975,1cyclictest60950irq/123-eno112:30:142
215809975,1cyclictest60950irq/123-eno112:25:142
215809975,1cyclictest60950irq/123-eno108:50:162
215809973,2cyclictest570-21systemd-logind09:05:202
215809971,2cyclictest0-21swapper/210:29:192
215809970,5cyclictest0-21swapper/211:29:482
215809970,4cyclictest21725-21runrttasks09:19:532
215809970,4cyclictest0-21swapper/210:19:212
215809970,4cyclictest0-21swapper/210:11:012
215809970,3cyclictest254-21systemd-journal08:08:452
215809970,3cyclictest0-21swapper/210:34:362
215769971,1cyclictest0-21swapper/108:19:591
215769971,1cyclictest0-21swapper/108:05:151
215769970,1cyclictest0-21swapper/108:50:001
215769970,1cyclictest0-21swapper/108:45:001
215769970,1cyclictest0-21swapper/107:30:001
215769970,1cyclictest0-21swapper/107:10:131
215689976,1cyclictest7754-21ntpq07:45:180
215689976,1cyclictest6191-21kernelversion08:50:170
215689976,1cyclictest5381-21ntpq07:40:160
215689976,1cyclictest4467-21kworker/0:012:10:110
215689975,1cyclictest30117-21diskstats12:30:140
215689973,2cyclictest22604-21/usr/sbin/munin10:50:200
215689972,3cyclictest1372-21sh11:05:160
215689972,2cyclictest0-21swapper/009:45:120
215689970,5cyclictest0-21swapper/009:53:130
215689970,4cyclictest0-21swapper/009:40:020
215689970,3cyclictest0-21swapper/010:25:140
215689970,1cyclictest0-21swapper/011:15:460
215689970,1cyclictest0-21swapper/009:12:330
18014270,0sleep30-21swapper/311:28:213
215899965,1cyclictest35-21ksoftirqd/307:25:013
215899965,1cyclictest29112-21apt-get12:30:013
215899965,1cyclictest24752-21ssh12:22:273
215899965,1cyclictest24475-21ssh09:22:003
215899965,1cyclictest17871-21ssh12:13:553
215899965,0cyclictest14491-21diskmemload11:02:533
215899964,1cyclictest5353-21ntpq11:55:183
215899964,1cyclictest22004-21ssh11:34:383
215899964,1cyclictest21109-21ssh10:46:123
215899964,1cyclictest20531-21ssh12:15:253
215899964,1cyclictest14491-21diskmemload12:25:083
215899964,0cyclictest14491-21diskmemload10:05:043
215899963,3cyclictest14491-21diskmemload11:50:503
215899963,1cyclictest254-21systemd-journal08:44:593
215899963,1cyclictest13049-21needreboot10:35:183
215899962,3cyclictest1767-21ssh09:35:163
215899962,2cyclictest12690-21/usr/sbin/munin09:05:143
215899961,3cyclictest14491-21diskmemload09:25:133
215899961,3cyclictest0-21swapper/312:35:143
215899961,1cyclictest7750-21apt-get12:00:103
215899961,1cyclictest0-21swapper/311:40:183
215899960,4cyclictest0-21swapper/310:00:193
215899960,3cyclictest0-21swapper/310:25:163
215899960,2cyclictest12879-21diskstats09:50:143
215899960,1cyclictest18793-21apt-get08:10:133
215809966,0cyclictest60950irq/123-eno112:10:012
215809966,0cyclictest60950irq/123-eno112:00:192
215809966,0cyclictest60950irq/123-eno111:03:532
215809966,0cyclictest60950irq/123-eno110:50:042
215809966,0cyclictest60950irq/123-eno110:35:112
215809966,0cyclictest60950irq/123-eno109:50:122
215809966,0cyclictest60950irq/123-eno109:30:232
215809966,0cyclictest60950irq/123-eno109:10:152
215809966,0cyclictest60950irq/123-eno108:58:222
215809966,0cyclictest60950irq/123-eno108:35:142
215809966,0cyclictest60950irq/123-eno107:25:132
215809966,0cyclictest60950irq/123-eno107:16:292
215809965,1cyclictest60950irq/123-eno111:50:122
215809965,1cyclictest60950irq/123-eno111:40:142
215809965,1cyclictest28-21ksoftirqd/211:45:142
215809964,1cyclictest60950irq/123-eno108:15:192
215809964,1cyclictest60950irq/123-eno107:45:172
215809964,1cyclictest60950irq/123-eno107:30:312
215809962,2cyclictest0-21swapper/211:20:122
215809960,4cyclictest14491-21diskmemload09:25:162
215809960,3cyclictest18793-21apt-get08:10:122
215809960,3cyclictest0-21swapper/211:31:352
215809960,3cyclictest0-21swapper/211:15:452
215809960,2cyclictest0-21swapper/211:35:132
215769961,1cyclictest0-21swapper/107:55:171
215769960,1cyclictest0-21swapper/108:30:141
215769960,1cyclictest0-21swapper/108:10:151
215769960,1cyclictest0-21swapper/107:50:111
215769960,1cyclictest0-21swapper/107:45:121
215769960,1cyclictest0-21swapper/107:40:111
215689965,1cyclictest9-21ksoftirqd/009:00:120
215689965,1cyclictest9-21ksoftirqd/007:15:000
215689965,1cyclictest31907-21ssh11:01:350
215689965,1cyclictest24146-21ssh09:21:010
215689965,1cyclictest21697-21ssh10:48:030
215689965,1cyclictest14242-21ssh10:37:010
215689963,1cyclictest254-21systemd-journal07:30:010
215689962,2cyclictest30126-21/usr/sbin/munin10:15:150
215689962,2cyclictest22416-21apt-get11:35:130
215689960,5cyclictest3059-21ssh09:35:410
215689960,5cyclictest18691-21ssh12:15:080
215689960,5cyclictest14491-21diskmemload12:35:080
215689960,3cyclictest32746-21tr08:40:000
215689960,3cyclictest14491-21diskmemload12:05:040
215689960,2cyclictest0-21swapper/011:10:160
215689960,2cyclictest0-21swapper/008:05:150
215689960,1cyclictest0-21swapper/010:55:350
215689960,1cyclictest0-21swapper/007:50:090
215689960,0cyclictest0-21swapper/008:40:210
215899955,0cyclictest14491-21diskmemload10:16:083
215899954,1cyclictest23598-21sshd07:11:193
215899954,1cyclictest15483-21sshd08:00:193
215899953,1cyclictest8562-21seq07:48:173
215899953,1cyclictest5981-21taskset07:40:223
215899953,1cyclictest3725-21hddtemp_smartct08:45:173
215899952,1cyclictest254-21systemd-journal08:30:013
215899952,1cyclictest254-21systemd-journal07:27:153
215899950,3cyclictest5277-21apt-get08:50:133
215899950,2cyclictest254-21systemd-journal07:20:003
215899950,0cyclictest0-21swapper/307:35:143
215809955,0cyclictest60950irq/123-eno107:50:082
215809955,0cyclictest60950irq/123-eno107:37:392
215809954,1cyclictest60950irq/123-eno108:20:132
215809954,1cyclictest60950irq/123-eno107:20:122
215809952,1cyclictest28-21ksoftirqd/209:02:092
215809950,1cyclictest0-21swapper/208:00:112
215689954,1cyclictest9-21ksoftirqd/007:55:170
215689954,1cyclictest9-21ksoftirqd/007:15:570
215689954,1cyclictest4467-21kworker/0:008:15:040
215689953,1cyclictest14488-21latency_hist09:09:590
215689952,1cyclictest9-21ksoftirqd/008:28:290
215689952,1cyclictest254-21systemd-journal08:24:540
215689952,1cyclictest254-21systemd-journal07:30:010
215689950,3cyclictest0-21swapper/008:45:140
215689950,1cyclictest0-21swapper/008:59:090
215899942,1cyclictest9454-21cut07:50:113
215899940,1cyclictest254-21systemd-journal08:05:153
215689940,4cyclictest0-21swapper/008:30:180
215689940,3cyclictest0-21swapper/008:10:130
215689940,1cyclictest819-21lldpd07:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional