You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-16 - 00:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Tue Jul 15, 2025 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
670324760,5sleep26707-21wc07:05:242
71652212162,24sleep30-21swapper/307:07:393
73242205151,42sleep10-21swapper/107:09:431
72242202122,21sleep00-21swapper/007:08:250
187742770,0sleep10-21swapper/110:15:081
77692660,0sleep10-21swapper/107:10:131
299572180,1sleep2467-21diskmemload10:30:002
173172160,0sleep00-21swapper/009:30:140
7442991412,1cyclictest9-21ksoftirqd/011:00:000
745199130,12cyclictest0-21swapper/111:40:191
7467991211,1cyclictest35-21ksoftirqd/309:34:593
7442991211,1cyclictest9-21ksoftirqd/010:00:160
7442991210,1cyclictest9-21ksoftirqd/009:10:000
746799110,8cyclictest25516-21/usr/sbin/munin11:50:233
744299119,1cyclictest9-21ksoftirqd/012:10:210
744299119,1cyclictest9-21ksoftirqd/009:25:010
744299119,1cyclictest9-21ksoftirqd/007:25:010
7442991111,0cyclictest9-21ksoftirqd/009:35:240
7442991110,1cyclictest9-21ksoftirqd/012:19:590
7442991110,1cyclictest9-21ksoftirqd/009:10:140
7442991110,1cyclictest24732-21ssh12:31:190
746799109,1cyclictest35-21ksoftirqd/309:10:003
746799109,1cyclictest35-21ksoftirqd/307:30:013
746799104,2cyclictest278-21systemd-udevd09:27:293
745999109,1cyclictest28-21ksoftirqd/209:18:292
745999100,9cyclictest0-21swapper/210:03:382
745999100,10cyclictest0-21swapper/212:07:392
744299109,1cyclictest9-21ksoftirqd/011:05:160
744299109,1cyclictest9-21ksoftirqd/010:40:220
744299109,1cyclictest21864-21ssh12:28:450
744299108,1cyclictest9-21ksoftirqd/011:50:180
744299108,1cyclictest9-21ksoftirqd/011:30:130
744299108,1cyclictest9-21ksoftirqd/010:20:010
744299102,7cyclictest9792-21munin-node12:07:050
74679990,8cyclictest0-21swapper/311:48:293
74429999,0cyclictest9-21ksoftirqd/010:45:140
74429999,0cyclictest9-21ksoftirqd/010:20:140
74429998,1cyclictest9-21ksoftirqd/012:00:140
74429998,1cyclictest2936-21ssh09:53:430
74429998,1cyclictest15271-21awk08:30:180
74429997,1cyclictest9-21ksoftirqd/009:55:160
74429997,1cyclictest27798-21ssh09:43:340
74429992,4cyclictest9840-21cat07:15:010
74429990,5cyclictest31677-21grep07:55:240
74679982,5cyclictest9792-21munin-node07:41:093
74679981,5cyclictest25061-21apt-get07:45:143
74679980,5cyclictest5604-21snmpd12:20:123
74679980,1cyclictest0-21swapper/311:40:123
74599987,1cyclictest22868-21sh09:36:182
74599986,1cyclictest60950irq/123-eno112:25:162
74599986,1cyclictest60950irq/123-eno109:25:152
74599986,1cyclictest5604-21snmpd12:34:392
74599986,1cyclictest5604-21snmpd11:27:042
74599986,1cyclictest16555-21ntpq07:25:192
74599984,1cyclictest254-21systemd-journal11:13:152
74599983,2cyclictest254-21systemd-journal10:24:592
74599980,5cyclictest15301-21apt-get12:20:122
74599980,4cyclictest12211-21/usr/sbin/munin11:30:212
74599980,3cyclictest0-21swapper/210:05:192
74519987,1cyclictest90-21printk09:27:281
74519982,3cyclictest0-21swapper/112:35:241
74519980,4cyclictest0-21swapper/110:30:151
74429988,0cyclictest9-21ksoftirqd/011:40:150
74429988,0cyclictest9-21ksoftirqd/011:15:160
74429988,0cyclictest9-21ksoftirqd/011:00:130
74429987,1cyclictest9-21ksoftirqd/011:20:210
74429986,1cyclictest9-21ksoftirqd/010:05:150
74429985,1cyclictest467-21diskmemload10:13:360
74429980,7cyclictest4772-21ssh09:15:110
74429980,2cyclictest0-21swapper/007:25:130
7434280,2sleep335-21ksoftirqd/310:41:263
74679975,1cyclictest32178-21ssh10:31:043
74679974,2cyclictest467-21diskmemload09:16:563
74679972,1cyclictest32362-21/usr/sbin/munin09:50:163
74679972,0cyclictest467-21diskmemload11:39:033
74679971,5cyclictest467-21diskmemload09:13:133
74679971,3cyclictest0-21swapper/307:50:013
74679971,2cyclictest467-21diskmemload09:35:033
74679970,6cyclictest29806-21munin-run10:29:593
74679970,5cyclictest0-21swapper/309:55:023
74679970,4cyclictest742-21runrttasks10:03:193
74679970,4cyclictest0-21swapper/307:10:143
74679970,3cyclictest0-21swapper/309:48:473
74679970,2cyclictest0-21swapper/309:24:363
74679970,1cyclictest1955-21awk12:00:193
74599976,1cyclictest60950irq/123-eno112:36:492
74599976,1cyclictest60950irq/123-eno112:19:062
74599976,1cyclictest60950irq/123-eno111:45:142
74599976,1cyclictest60950irq/123-eno111:40:202
74599976,1cyclictest60950irq/123-eno111:35:122
74599976,1cyclictest60950irq/123-eno110:50:182
74599976,1cyclictest60950irq/123-eno110:19:082
74599976,1cyclictest60950irq/123-eno109:46:522
74599976,1cyclictest60950irq/123-eno109:20:182
74599976,1cyclictest60950irq/123-eno109:10:172
74599976,1cyclictest60950irq/123-eno108:09:062
74599976,1cyclictest25464-21ntpq11:05:202
74599976,0cyclictest60950irq/123-eno111:03:582
74599976,0cyclictest60950irq/123-eno110:56:172
74599975,1cyclictest60950irq/123-eno111:50:202
74599975,1cyclictest60950irq/123-eno111:20:162
74599975,1cyclictest5604-21snmpd12:10:392
74599975,1cyclictest28-21ksoftirqd/211:55:252
74599975,1cyclictest28-21ksoftirqd/207:15:012
74599974,1cyclictest60950irq/123-eno110:32:142
74599973,2cyclictest254-21systemd-journal12:00:012
74599972,4cyclictest554-21in:imuxsock07:35:012
74599972,3cyclictest554-21in:imuxsock10:40:002
74599971,5cyclictest742-21runrttasks09:55:422
74599971,2cyclictest0-21swapper/210:40:202
74599970,2cyclictest0-21swapper/209:43:172
74519971,3cyclictest0-21swapper/107:20:211
74519970,6cyclictest0-21swapper/112:25:151
74519970,6cyclictest0-21swapper/108:25:181
74519970,4cyclictest0-21swapper/109:14:121
74519970,3cyclictest0-21swapper/110:35:011
74519970,1cyclictest0-21swapper/112:07:151
74429977,0cyclictest9-21ksoftirqd/012:20:160
74429976,1cyclictest9-21ksoftirqd/010:25:150
74429976,1cyclictest14686-21ssh09:25:440
74429975,1cyclictest9-21ksoftirqd/008:30:010
74429975,1cyclictest9-21ksoftirqd/007:15:000
74429975,1cyclictest21782-21ssh11:45:070
74429973,2cyclictest254-21systemd-journal08:24:400
74429972,2cyclictest467-21diskmemload11:25:010
74429970,6cyclictest3503-21ssh10:36:030
74429970,6cyclictest29666-21ssh11:55:140
74429970,3cyclictest30771-21ssh09:46:210
74429970,3cyclictest0-21swapper/007:35:120
74429970,2cyclictest0-21swapper/012:35:150
74429970,1cyclictest0-21swapper/011:38:500
74429970,1cyclictest0-21swapper/011:10:130
74429970,1cyclictest0-21swapper/010:50:160
74429970,1cyclictest0-21swapper/007:45:150
11736270,1sleep30-21swapper/310:47:573
74679965,1cyclictest9330-21ssh11:26:473
74679965,1cyclictest5604-21snmpd12:30:013
74679965,1cyclictest5604-21snmpd12:05:333
74679965,1cyclictest27371-21ssh09:42:283
74679965,1cyclictest22429-21ssh11:00:403
74679965,1cyclictest19432-21ssh10:57:503
74679965,1cyclictest18744-21ssh10:15:033
74679965,1cyclictest17316-21cat08:35:153
74679964,1cyclictest467-21diskmemload11:20:403
74679964,1cyclictest31639-21ssh11:57:273
74679964,1cyclictest23716-21apt-get08:50:133
74679964,1cyclictest15025-21apt-get10:10:123
74679964,0cyclictest467-21diskmemload12:15:363
74679964,0cyclictest467-21diskmemload11:11:063
74679963,1cyclictest254-21systemd-journal08:28:573
74679963,1cyclictest11218-21runrttasks10:05:073
74679961,3cyclictest0-21swapper/312:35:173
74679961,2cyclictest0-21swapper/308:10:113
74679961,1cyclictest0-21swapper/312:10:203
74679960,4cyclictest0-21swapper/307:55:183
74679960,3cyclictest0-21swapper/310:35:263
74679960,2cyclictest0-21swapper/311:06:023
74679960,2cyclictest0-21swapper/310:50:513
74679960,2cyclictest0-21swapper/309:00:153
74679960,2cyclictest0-21swapper/308:40:153
74679960,1cyclictest0-21swapper/311:32:053
74679960,1cyclictest0-21swapper/311:15:213
74679960,1cyclictest0-21swapper/310:22:103
74599966,0cyclictest60950irq/123-eno109:30:122
74599966,0cyclictest60950irq/123-eno109:00:132
74599966,0cyclictest60950irq/123-eno108:51:512
74599966,0cyclictest60950irq/123-eno108:40:142
74599966,0cyclictest60950irq/123-eno108:13:452
74599966,0cyclictest60950irq/123-eno107:52:432
74599965,1cyclictest8987-21ssh10:45:022
74599965,1cyclictest852-21cat09:50:162
74599965,1cyclictest13493-21sshd08:25:432
74599964,1cyclictest60950irq/123-eno108:20:152
74599964,1cyclictest30691-21grep07:55:182
74599963,1cyclictest254-21systemd-journal07:25:012
74599961,3cyclictest31910-21hostname11:15:122
74599960,5cyclictest0-21swapper/208:30:122
74599960,3cyclictest0-21swapper/208:55:142
74599960,1cyclictest0-21swapper/210:10:242
74519966,0cyclictest0-21swapper/111:37:181
74519961,3cyclictest0-21swapper/109:40:221
74519960,6cyclictest0-21swapper/111:25:171
74519960,5cyclictest28483-21taskset10:26:231
74519960,4cyclictest0-21swapper/111:55:151
74519960,4cyclictest0-21swapper/111:48:111
74519960,3cyclictest0-21swapper/112:32:451
74519960,3cyclictest0-21swapper/112:20:081
74519960,3cyclictest0-21swapper/112:10:521
74519960,3cyclictest0-21swapper/109:55:071
74519960,3cyclictest0-21swapper/109:22:061
74519960,2cyclictest0-21swapper/112:00:011
74519960,2cyclictest0-21swapper/111:50:181
74519960,2cyclictest0-21swapper/111:05:421
74519960,2cyclictest0-21swapper/110:10:091
74519960,2cyclictest0-21swapper/107:55:201
74519960,2cyclictest0-21swapper/107:30:121
74519960,1cyclictest0-21swapper/108:20:131
74519960,0cyclictest0-21swapper/110:43:261
74429965,1cyclictest9-21ksoftirqd/008:55:210
74429965,1cyclictest9-21ksoftirqd/007:50:140
74429965,1cyclictest9-21ksoftirqd/007:30:160
74429965,1cyclictest21156-21/usr/sbin/munin08:45:200
74429962,1cyclictest254-21systemd-journal08:35:270
74429960,6cyclictest32060-21ssh10:30:450
74429960,6cyclictest0-21swapper/008:50:190
74429960,6cyclictest0-21swapper/008:40:110
74429960,6cyclictest0-21swapper/007:43:280
74429960,5cyclictest0-21swapper/008:00:140
74429960,4cyclictest0-21swapper/009:00:210
74429960,1cyclictest254-21systemd-journal08:14:560
74429960,0cyclictest0-21swapper/008:16:420
21781260,0sleep10-21swapper/111:00:181
20810260,0sleep320814-21ssh12:25:363
74679954,1cyclictest8144-21ntp_states08:15:183
74679954,1cyclictest15066-21sshd07:23:433
74679952,2cyclictest21265-21hostname08:45:133
74679951,3cyclictest14076-21apt-get08:30:123
74679951,3cyclictest0-21swapper/308:10:013
74679951,2cyclictest0-21swapper/308:20:133
74679950,2cyclictest28207-21perf09:00:003
74599954,1cyclictest60950irq/123-eno107:35:142
74599954,0cyclictest60950irq/123-eno107:40:012
74599953,1cyclictest25836-21cut07:45:172
74599953,1cyclictest0-21swapper/208:00:152
74599950,5cyclictest0-21swapper/207:18:542
74599950,4cyclictest21156-21/usr/sbin/munin08:45:142
74599950,3cyclictest6979-21apt-get08:15:112
74599950,1cyclictest0-21swapper/209:05:132
74599950,1cyclictest0-21swapper/208:35:112
74519953,1cyclictest12942-21chrt11:31:301
74519951,3cyclictest0-21swapper/108:50:191
74519951,2cyclictest0-21swapper/109:15:121
74519950,5cyclictest0-21swapper/110:21:011
74519950,5cyclictest0-21swapper/107:37:291
74519950,4cyclictest0-21swapper/111:15:281
74519950,4cyclictest0-21swapper/109:32:531
74519950,4cyclictest0-21swapper/108:35:101
74519950,3cyclictest0-21swapper/110:45:471
74519950,3cyclictest0-21swapper/109:50:461
74519950,2cyclictest0-21swapper/111:20:081
74519950,2cyclictest0-21swapper/111:10:171
74519950,2cyclictest0-21swapper/110:56:041
74519950,2cyclictest0-21swapper/110:06:141
74519950,2cyclictest0-21swapper/110:00:371
74519950,2cyclictest0-21swapper/109:35:191
74519950,2cyclictest0-21swapper/107:50:161
74519950,1cyclictest0-21swapper/112:15:171
74519950,1cyclictest0-21swapper/108:55:131
74519950,0cyclictest0-21swapper/108:46:411
74429950,0cyclictest0-21swapper/008:05:220
74679944,0cyclictest10272-21sensors07:15:013
74679942,1cyclictest32665-21cstates08:00:153
74679941,2cyclictest20124-21apt-get07:35:123
74679940,1cyclictest0-21swapper/307:30:143
74519940,4cyclictest0-21swapper/107:45:281
74519940,2cyclictest0-21swapper/109:00:181
74519940,2cyclictest0-21swapper/108:40:201
74519940,2cyclictest0-21swapper/108:15:141
74519940,2cyclictest0-21swapper/107:25:271
74519940,1cyclictest0-21swapper/110:50:201
74519940,1cyclictest0-21swapper/109:05:121
74519940,1cyclictest0-21swapper/108:00:131
74519940,0cyclictest0-21swapper/109:45:071
74519931,1cyclictest0-21swapper/108:30:131
74519931,1cyclictest0-21swapper/108:10:131
74519931,1cyclictest0-21swapper/107:40:011
74519930,3cyclictest0-21swapper/107:15:011
74519930,1cyclictest0-21swapper/108:05:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional