You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 18:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Nov 12, 2025 12:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291142199160,26sleep20-21swapper/207:05:502
292972198162,23sleep10-21swapper/107:08:141
291172197160,24sleep00-21swapper/007:05:520
291822196158,25sleep30-21swapper/307:06:443
323042720,0sleep10-21swapper/108:20:151
289722690,0sleep10-21swapper/112:19:181
29530991918,1cyclictest9-21ksoftirqd/010:10:130
2953899130,12cyclictest0-21swapper/112:25:141
2953899130,12cyclictest0-21swapper/108:50:131
29530991312,1cyclictest9-21ksoftirqd/012:05:170
29530991312,1cyclictest9-21ksoftirqd/009:40:150
29530991312,1cyclictest9-21ksoftirqd/009:30:010
29547991210,1cyclictest28-21ksoftirqd/212:20:222
29547991210,1cyclictest28-21ksoftirqd/208:14:592
2953099123,4cyclictest4594-21sort11:00:000
29530991211,1cyclictest9-21ksoftirqd/010:20:000
29555991110,1cyclictest35-21ksoftirqd/311:00:003
2955599110,8cyclictest19110-21snmpd09:14:573
2954799119,1cyclictest28-21ksoftirqd/211:20:012
29547991110,1cyclictest28-21ksoftirqd/209:55:122
2953099113,4cyclictest31506-21perf08:20:000
29530991110,1cyclictest9-21ksoftirqd/012:40:000
29530991110,1cyclictest9-21ksoftirqd/011:58:490
29530991110,1cyclictest9-21ksoftirqd/011:45:140
2953099111,5cyclictest28864-21apt-get08:15:000
2954799109,1cyclictest28-21ksoftirqd/212:15:142
2954799109,1cyclictest28-21ksoftirqd/211:00:132
2954799109,1cyclictest28-21ksoftirqd/210:55:112
2954799109,1cyclictest28-21ksoftirqd/210:10:012
2954799109,1cyclictest28-21ksoftirqd/210:01:032
2954799109,1cyclictest28-21ksoftirqd/209:45:182
2954799109,1cyclictest28-21ksoftirqd/209:20:202
2954799109,1cyclictest28-21ksoftirqd/207:15:002
2954799108,1cyclictest28-21ksoftirqd/211:25:132
29547991010,0cyclictest28-21ksoftirqd/210:30:222
2954799100,6cyclictest21409-21/usr/sbin/munin09:50:192
2953099109,1cyclictest9-21ksoftirqd/012:20:160
2953099109,1cyclictest9-21ksoftirqd/012:10:200
2953099109,1cyclictest9-21ksoftirqd/011:50:170
2953099109,1cyclictest9-21ksoftirqd/011:02:340
2953099109,1cyclictest9-21ksoftirqd/010:50:160
2953099109,1cyclictest9-21ksoftirqd/010:22:140
2953099109,1cyclictest9-21ksoftirqd/009:15:140
2953099108,1cyclictest9-21ksoftirqd/011:05:170
29530991010,0cyclictest9-21ksoftirqd/011:40:180
29530991010,0cyclictest9-21ksoftirqd/009:35:120
29530991010,0cyclictest9-21ksoftirqd/009:30:160
2953099100,6cyclictest19110-21snmpd09:24:240
295559998,1cyclictest35-21ksoftirqd/307:50:013
295479999,0cyclictest28-21ksoftirqd/212:10:002
295479999,0cyclictest28-21ksoftirqd/211:45:162
295479999,0cyclictest28-21ksoftirqd/211:10:182
295479999,0cyclictest28-21ksoftirqd/209:40:202
295479999,0cyclictest0-21swapper/209:11:562
295479998,1cyclictest28-21ksoftirqd/211:55:242
295479998,1cyclictest28-21ksoftirqd/211:40:122
295479998,1cyclictest28-21ksoftirqd/211:20:142
295479998,1cyclictest28-21ksoftirqd/210:18:012
295479998,0cyclictest28-21ksoftirqd/209:25:152
295479997,1cyclictest28-21ksoftirqd/210:27:312
295389998,1cyclictest21-21ksoftirqd/112:30:301
295389995,4cyclictest21-21ksoftirqd/111:36:541
295389990,7cyclictest0-21swapper/110:55:111
295309999,0cyclictest9-21ksoftirqd/009:48:130
295309998,1cyclictest9-21ksoftirqd/011:30:200
295309998,1cyclictest9-21ksoftirqd/009:55:140
295309998,1cyclictest9-21ksoftirqd/007:40:140
295309997,1cyclictest9-21ksoftirqd/012:25:160
295309997,1cyclictest9-21ksoftirqd/011:20:150
295309990,5cyclictest26664-21perf09:15:000
3566280,1sleep10-21swapper/111:43:181
295559988,0cyclictest35-21ksoftirqd/310:00:203
295559987,1cyclictest35-21ksoftirqd/309:30:013
295559986,1cyclictest19110-21snmpd08:31:353
295559980,6cyclictest0-21swapper/312:10:583
295479988,0cyclictest28-21ksoftirqd/212:30:142
295479988,0cyclictest28-21ksoftirqd/212:05:152
295479988,0cyclictest28-21ksoftirqd/212:00:132
295479988,0cyclictest28-21ksoftirqd/209:37:512
295479987,1cyclictest60950irq/123-eno109:00:132
295479987,1cyclictest28-21ksoftirqd/212:35:552
295479987,1cyclictest28-21ksoftirqd/211:50:122
295479987,1cyclictest28-21ksoftirqd/210:35:112
295479987,1cyclictest28-21ksoftirqd/208:55:162
295479987,1cyclictest28-21ksoftirqd/207:40:182
295479987,1cyclictest23042-21diskmemload10:45:212
295479987,0cyclictest28-21ksoftirqd/212:25:082
295479986,1cyclictest28-21ksoftirqd/210:40:142
295479986,1cyclictest28-21ksoftirqd/209:15:152
295389988,0cyclictest21-21ksoftirqd/112:20:191
295389988,0cyclictest21-21ksoftirqd/112:04:211
295389988,0cyclictest21-21ksoftirqd/109:40:171
295389988,0cyclictest21-21ksoftirqd/108:37:251
295389980,7cyclictest0-21swapper/110:25:101
295389980,7cyclictest0-21swapper/107:30:141
295389980,0cyclictest111rcu_preempt10:50:161
295309988,0cyclictest9-21ksoftirqd/012:30:130
295309988,0cyclictest9-21ksoftirqd/012:15:140
295309988,0cyclictest9-21ksoftirqd/010:35:130
295309988,0cyclictest9-21ksoftirqd/010:08:320
295309988,0cyclictest9-21ksoftirqd/008:35:130
295309987,1cyclictest9-21ksoftirqd/011:25:200
295309987,1cyclictest9-21ksoftirqd/010:30:190
295309987,1cyclictest9-21ksoftirqd/008:25:150
295309987,1cyclictest9-21ksoftirqd/007:50:130
295309987,1cyclictest9-21ksoftirqd/007:45:150
295309987,1cyclictest9-21ksoftirqd/007:20:140
295309986,1cyclictest9-21ksoftirqd/010:00:160
295309986,1cyclictest9-21ksoftirqd/007:15:130
295559976,1cyclictest546-21irqbalance12:15:353
295559976,1cyclictest19110-21snmpd10:43:063
295559976,1cyclictest19110-21snmpd10:16:393
295559976,1cyclictest19110-21snmpd09:31:013
295559976,1cyclictest19110-21snmpd08:21:173
295559975,1cyclictest35-21ksoftirqd/308:10:003
295559975,1cyclictest32748-21ssh10:52:493
295559975,1cyclictest29480-21ssh12:20:053
295559975,1cyclictest23042-21diskmemload10:20:313
295559975,1cyclictest21215-21ssh11:21:143
295559975,1cyclictest19110-21snmpd08:36:353
295559975,1cyclictest19110-21snmpd07:40:093
295559974,2cyclictest23042-21diskmemload10:11:133
295559974,1cyclictest254-21systemd-journal09:05:003
295559973,3cyclictest23042-21diskmemload11:00:123
295559972,4cyclictest30630-21apt-get09:20:143
295559972,2cyclictest23042-21diskmemload12:34:043
295559971,4cyclictest0-21swapper/311:50:483
295559970,7cyclictest25300-21ssh11:28:023
295559970,5cyclictest0-21swapper/309:35:403
295559970,4cyclictest19110-21snmpd09:16:003
295559970,3cyclictest0-21swapper/311:40:113
295479977,0cyclictest28-21ksoftirqd/211:05:202
295479977,0cyclictest28-21ksoftirqd/210:20:002
295479977,0cyclictest28-21ksoftirqd/210:10:082
295479976,1cyclictest60950irq/123-eno111:35:592
295479976,1cyclictest60950irq/123-eno111:30:122
295479976,1cyclictest28-21ksoftirqd/210:52:192
295479976,1cyclictest28-21ksoftirqd/207:20:122
295479975,1cyclictest60950irq/123-eno107:30:162
295479970,2cyclictest5848-21apt-get09:30:122
295389977,0cyclictest21-21ksoftirqd/112:36:391
295389977,0cyclictest21-21ksoftirqd/111:47:571
295389977,0cyclictest21-21ksoftirqd/111:12:331
295389977,0cyclictest21-21ksoftirqd/110:31:031
295389977,0cyclictest21-21ksoftirqd/109:56:591
295389977,0cyclictest21-21ksoftirqd/109:36:491
295389977,0cyclictest21-21ksoftirqd/109:25:591
295389977,0cyclictest21-21ksoftirqd/107:48:151
295389976,1cyclictest21-21ksoftirqd/110:35:191
295389973,1cyclictest0-21swapper/110:06:461
295389972,5cyclictest56-21kworker/1:108:45:351
295389971,1cyclictest111rcu_preempt08:00:161
295389970,7cyclictest0-21swapper/111:25:121
295389970,7cyclictest0-21swapper/110:20:561
295389970,7cyclictest0-21swapper/110:11:401
295389970,7cyclictest0-21swapper/109:52:041
295389970,5cyclictest0-21swapper/111:05:341
295389970,5cyclictest0-21swapper/109:05:141
295389970,4cyclictest0-21swapper/111:55:181
295389970,4cyclictest0-21swapper/109:20:431
295389970,0cyclictest111rcu_preempt10:03:541
295389970,0cyclictest0-21swapper/107:40:161
295309977,0cyclictest9-21ksoftirqd/011:35:120
295309977,0cyclictest9-21ksoftirqd/010:25:230
295309976,1cyclictest9-21ksoftirqd/011:15:160
295309976,1cyclictest9-21ksoftirqd/009:50:180
295309976,1cyclictest9-21ksoftirqd/008:50:010
295309976,1cyclictest9-21ksoftirqd/008:45:000
295309976,1cyclictest14048-21nscd08:00:010
295309975,1cyclictest14336-21df_inode08:50:150
295309971,3cyclictest254-21systemd-journal09:05:000
295309970,4cyclictest0-21swapper/011:14:440
295309970,4cyclictest0-21swapper/010:40:040
31672260,1sleep30-21swapper/311:35:503
295559965,1cyclictest35-21ksoftirqd/307:15:003
295559965,1cyclictest29186-21ssh10:47:463
295559965,1cyclictest29121-21ssh11:34:003
295559965,1cyclictest20593-21ntpq07:55:203
295559965,1cyclictest19110-21snmpd09:55:373
295559965,1cyclictest19110-21snmpd09:07:423
295559965,1cyclictest19110-21snmpd08:56:063
295559965,1cyclictest19110-21snmpd08:45:163
295559965,1cyclictest17156-21ssh12:01:393
295559965,1cyclictest11973-21ssh11:55:173
295559965,1cyclictest10522-21ssh11:05:533
295559965,1cyclictest10111-21ssh12:37:243
295559964,1cyclictest19110-21snmpd08:01:313
295559964,1cyclictest18751-21ssh11:19:403
295559964,0cyclictest23042-21diskmemload10:30:043
295559963,1cyclictest254-21systemd-journal08:19:593
295559963,1cyclictest254-21systemd-journal07:40:003
295559962,1cyclictest23042-21diskmemload10:35:173
295559961,4cyclictest29728-21apt-get07:10:123
295559961,3cyclictest23042-21diskmemload10:25:393
295559961,3cyclictest23042-21diskmemload09:45:123
295559961,1cyclictest14925-21users09:40:223
295559960,3cyclictest23042-21diskmemload09:50:023
295559960,3cyclictest0-21swapper/312:25:123
295559960,3cyclictest0-21swapper/312:05:203
295559960,2cyclictest0-21swapper/311:10:183
295479966,0cyclictest60950irq/123-eno109:05:142
295479966,0cyclictest60950irq/123-eno108:30:092
295479966,0cyclictest60950irq/123-eno108:08:262
295479966,0cyclictest60950irq/123-eno108:04:132
295479966,0cyclictest60950irq/123-eno107:56:392
295479966,0cyclictest60950irq/123-eno107:46:582
295479966,0cyclictest60950irq/123-eno107:27:342
295479966,0cyclictest12647-21kworker/2:008:20:192
295479965,1cyclictest60950irq/123-eno108:50:132
295479965,1cyclictest60950irq/123-eno107:50:192
295479965,1cyclictest28-21ksoftirqd/208:40:132
295479965,1cyclictest28-21ksoftirqd/208:15:022
295479965,1cyclictest28-21ksoftirqd/207:35:132
295479965,1cyclictest28-21ksoftirqd/207:15:132
295479965,1cyclictest12647-21kworker/2:008:25:172
295389966,0cyclictest21-21ksoftirqd/111:50:471
295389966,0cyclictest21-21ksoftirqd/111:23:231
295389966,0cyclictest21-21ksoftirqd/107:20:131
295389966,0cyclictest0-21swapper/112:10:131
295389965,1cyclictest21-21ksoftirqd/111:30:121
295389965,1cyclictest21-21ksoftirqd/107:35:151
295389964,1cyclictest0-21swapper/108:15:021
295389961,2cyclictest0-21swapper/109:15:561
295389960,6cyclictest0-21swapper/112:05:161
295389960,6cyclictest0-21swapper/111:04:501
295389960,6cyclictest0-21swapper/108:55:231
295389960,6cyclictest0-21swapper/108:40:121
295389960,6cyclictest0-21swapper/108:34:111
295389960,6cyclictest0-21swapper/108:12:481
295389960,6cyclictest0-21swapper/107:54:521
295389960,5cyclictest0-21swapper/109:45:101
295389960,5cyclictest0-21swapper/109:32:401
295389960,4cyclictest0-21swapper/110:17:521
295389960,3cyclictest0-21swapper/107:55:171
295389960,1cyclictest0-21swapper/109:03:141
295389960,1cyclictest0-21swapper/107:29:371
295389960,0cyclictest111rcu_preempt10:40:151
295309966,0cyclictest9-21ksoftirqd/008:00:130
295309965,1cyclictest9-21ksoftirqd/008:55:130
295309965,1cyclictest9-21ksoftirqd/008:05:140
295309965,1cyclictest9-21ksoftirqd/007:10:210
295309965,1cyclictest15422-21cat12:00:140
295309960,6cyclictest0-21swapper/008:34:160
295309960,5cyclictest6167-21needreboot07:25:190
295309960,5cyclictest477-21pmu-power08:20:190
295309960,2cyclictest23042-21diskmemload10:45:200
295559954,1cyclictest35-21ksoftirqd/308:40:133
295559954,1cyclictest35-21ksoftirqd/307:21:373
295559953,1cyclictest9680-21cut07:35:003
295559953,0cyclictest23042-21diskmemload11:45:383
295559952,2cyclictest23042-21diskmemload10:05:163
295559951,3cyclictest13829-21apt-get08:50:133
295559950,5cyclictest0-21swapper/308:12:483
295559950,3cyclictest5898-21hddtemp_smartct07:25:173
295559950,0cyclictest0-21swapper/307:45:123
295479955,0cyclictest12647-21kworker/2:008:35:132
295479954,1cyclictest60950irq/123-eno108:45:122
295389955,0cyclictest21-21ksoftirqd/107:15:201
295389954,1cyclictest21-21ksoftirqd/109:10:141
295389950,5cyclictest0-21swapper/111:15:111
295389950,5cyclictest0-21swapper/108:25:211
295389950,1cyclictest0-21swapper/110:45:121
295309954,1cyclictest9-21ksoftirqd/007:30:130
295309950,3cyclictest0-21swapper/007:35:170
295559940,3cyclictest1627-21apt-get08:25:133
295389943,1cyclictest21-21ksoftirqd/108:05:141
295389940,0cyclictest0-21swapper/107:10:211
295309941,2cyclictest20922-21apt-get09:05:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional