You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 14:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Mar 19, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
102149913033,28cyclictest0-21swapper/023:05:100
974321207,17sleep00-21swapper/019:00:580
8727211250,17sleep1181rcu_preempt19:00:091
10214991094,31cyclictest22223-21timerwakeupswit22:05:330
10214991094,31cyclictest22223-21timerwakeupswit22:05:330
102149910850,10cyclictest10756-21ntp_kernel_pll_23:35:260
102149910850,10cyclictest10756-21ntp_kernel_pll_23:35:260
102149910844,9cyclictest0-21swapper/023:45:180
102279910151,42cyclictest0-21swapper/223:00:232
102279910051,41cyclictest300-21rs:main2
102279910051,41cyclictest300-21rs:main2
10214999726,25cyclictest7896-21apt-get00:25:150
10214999726,25cyclictest7896-21apt-get00:25:150
10227999641,42cyclictest0-21swapper/220:45:012
10227999640,33cyclictest181rcu_preempt23:15:002
1021899963,38cyclictest7395-21ssh21:40:341
1021899963,38cyclictest7395-21ssh21:40:341
10227999548,40cyclictest0-21swapper/221:30:322
10227999447,40cyclictest0-21swapper/221:54:552
10227999264,19cyclictest1468-21apt-key00:15:012
1022799915,59cyclictest23916-21apt-get21:15:132
10227999140,41cyclictest0-21swapper/221:40:002
1022799913,8cyclictest0-21swapper/220:45:132
10218999150,34cyclictest22225-21timerwakeupswit22:05:331
10218999150,34cyclictest22225-21timerwakeupswit22:05:331
10227999048,34cyclictest0-21swapper/222:00:232
10227999048,34cyclictest0-21swapper/222:00:232
10227999046,36cyclictest0-21swapper/220:15:262
10227999044,38cyclictest0-21swapper/223:30:002
10227998845,36cyclictest29879-21latency_hist22:20:002
1022799883,74cyclictest19006-21latency_hist19:30:012
10227998747,33cyclictest17340-21diskmemload22:46:042
10227998740,38cyclictest0-21swapper/222:55:332
1022799872,34cyclictest23174-21ssh21:14:322
10227998646,11cyclictest181rcu_preempt23:55:012
10227998642,37cyclictest0-21swapper/222:37:252
10227998639,38cyclictest0-21swapper/200:00:222
1022799863,35cyclictest31292-21/usr/sbin/munin22:20:352
1022799863,31cyclictest24764-21cut23:05:192
1022799863,31cyclictest21011-21fschecks_time19:35:202
10218998645,33cyclictest0-21swapper/119:26:031
1021899864,36cyclictest18778-21latency22:00:231
1021899864,36cyclictest18778-21latency22:00:231
10218998636,36cyclictest32260-21apt-get20:10:261
1021899863,30cyclictest25915-21rm21:18:051
10227998544,33cyclictest0-21swapper/220:25:302
10227998544,33cyclictest0-21swapper/220:25:302
1022799854,27cyclictest17590-21runrttasks22:53:082
1022799854,27cyclictest17590-21runrttasks22:53:082
1022799853,27cyclictest15558-21runrttasks20:58:042
1022799852,8cyclictest6406-21ssh21:40:132
1022799852,8cyclictest6406-21ssh21:40:132
1022799852,35cyclictest12205-21munin-node19:10:082
10218998565,14cyclictest17340-21diskmemload22:15:351
1021899852,37cyclictest27879-21latency_hist00:05:001
10227998439,35cyclictest0-21swapper/220:30:232
1022799843,8cyclictest0-21swapper/219:55:122
1022799843,34cyclictest28679-21/usr/sbin/munin00:05:282
1022799843,34cyclictest28679-21/usr/sbin/munin00:05:282
1022799843,34cyclictest24681-21/usr/sbin/munin19:45:322
1022799843,34cyclictest24681-21/usr/sbin/munin19:45:322
1022799843,32cyclictest9643-21fschecks_time21:45:192
1022799842,34cyclictest12891-21/usr/sbin/munin20:50:172
1022799842,32cyclictest9269-21idleruntime-cro20:39:572
1022799842,32cyclictest22807-21grep23:55:322
10218998463,10cyclictest0-21swapper/123:45:331
1021899844,12cyclictest0-21swapper/121:50:091
1021899843,39cyclictest2454-21ssh00:16:301
1021899843,35cyclictest3378-21/usr/sbin/munin21:35:141
918328326,37sleep30-21swapper/319:00:323
1022799836,31cyclictest10856-21/usr/sbin/munin00:30:082
10227998346,30cyclictest0-21swapper/219:10:002
1022799833,34cyclictest1069-21/usr/sbin/munin22:25:202
1022799833,33cyclictest3583-21/usr/sbin/munin20:20:252
1022799833,33cyclictest3583-21/usr/sbin/munin20:20:252
1022799833,28cyclictest30420-21apt-get20:05:092
1022799832,34cyclictest16177-21/usr/sbin/munin21:55:322
1021899832,35cyclictest28821-21switchtime00:05:311
1021899832,35cyclictest28821-21switchtime00:05:311
10227998258,13cyclictest0-21swapper/221:00:192
1022799823,40cyclictest30513-21ntp_states21:25:282
1022799823,40cyclictest30513-21ntp_states21:25:282
1022799823,31cyclictest24872-21/usr/sbin/munin22:10:282
1022799823,27cyclictest352-21runrttasks00:17:122
1022799822,39cyclictest1099-21sort23:20:022
1022799822,39cyclictest1099-21sort23:20:022
1022799822,35cyclictest22325-21grep22:05:342
1022799822,35cyclictest22325-21grep22:05:342
10227998222,52cyclictest0-21swapper/223:40:122
1021899826,10cyclictest0-21swapper/121:57:151
1021899824,36cyclictest24800-21fschecks_time23:05:191
1021899823,38cyclictest31589-21ssh21:27:181
1021899823,38cyclictest31589-21ssh21:27:181
1021899822,40cyclictest7208-21ssh23:30:131
1021899822,25cyclictest13450-21fschecks_time23:40:191
10227998139,35cyclictest0-21swapper/222:30:252
1022799813,36cyclictest9652-21apt-get22:40:092
1022799813,36cyclictest9652-21apt-get22:40:092
1022799813,34cyclictest27298-21/usr/sbin/munin21:20:212
1022799812,35cyclictest9826-21munin-plugin-st23:34:572
1022799812,33cyclictest17907-21/usr/sbin/munin21:05:202
1022799812,32cyclictest29288-21/usr/sbin/munin20:00:242
1022799812,30cyclictest26462-21unixbench_multi19:50:342
1021899817,8cyclictest0-21swapper/123:24:071
10218998160,12cyclictest0-21swapper/123:35:221
10218998160,12cyclictest0-21swapper/123:35:221
10218998146,26cyclictest0-21swapper/119:35:011
1021899814,11cyclictest0-21swapper/123:10:371
1021899813,36cyclictest8661-21ntp_states00:25:531
1021899813,36cyclictest8661-21ntp_states00:25:531
1021899813,33cyclictest30402-21/usr/sbin/munin20:05:301
10218998110,43cyclictest17340-21diskmemload21:35:001
10214998165,9cyclictest1335-21ssh00:14:590
10227998042,31cyclictest0-21swapper/223:21:112
1022799803,34cyclictest16385-21tune2fs23:45:182
1022799802,33cyclictest335-21/usr/sbin/munin20:10:482
1021899804,24cyclictest17404-21latency_hist19:25:021
1021899803,36cyclictest6356-21munin-run22:34:581
1021899803,24cyclictest10107-21seq22:40:231
1021899803,24cyclictest10107-21seq22:40:231
10218998032,40cyclictest0-21swapper/123:50:341
10218998031,40cyclictest0-21swapper/100:30:251
10218998021,51cyclictest0-21swapper/122:55:341
10218998016,55cyclictest13716-21awk20:50:351
10214998058,16cyclictest27795-21fschecks_time23:10:190
1022799793,31cyclictest5592-21/usr/sbin/munin00:20:322
1022799792,33cyclictest17299-21sed19:25:012
1022799792,32cyclictest7861-21runrttasks00:25:042
1022799792,32cyclictest7861-21runrttasks00:25:042
1022799792,32cyclictest22545-21tune2fs19:40:192
1022799792,32cyclictest22545-21tune2fs19:40:192
10218997963,9cyclictest0-21swapper/123:00:311
1021899793,36cyclictest3262-21fschecks_count20:20:191
1021899793,36cyclictest3262-21fschecks_count20:20:191
1021899793,36cyclictest15862-21fschecks_time22:50:201
1021899793,36cyclictest15862-21fschecks_time22:50:201
1021899793,26cyclictest7351-21apt-get00:24:571
1021899793,26cyclictest32025-21unixbench_singl00:10:331
10218997930,39cyclictest0-21swapper/122:11:571
1021899792,35cyclictest10856-21modprobe20:44:571
1021899792,32cyclictest17495-21runrttasks21:05:001
10218997915,26cyclictest10784-21cat19:05:211
10214997963,10cyclictest32469-21runrttasks20:10:410
10214997960,13cyclictest14227-21latency_hist20:55:000
10214997957,14cyclictest25460-21latency_hist19:50:000
10214997957,14cyclictest25460-21latency_hist19:50:000
903927823,28sleep20-21swapper/219:00:272
1022799783,31cyclictest14038-21/usr/sbin/munin19:15:132
1021899783,26cyclictest15288-21modprobe22:49:571
1021899783,21cyclictest20621-21/usr/sbin/munin21:10:071
1021899782,29cyclictest4673-21latency23:25:231
1021899782,26cyclictest7756-21grep22:35:331
1021899782,24cyclictest352-21runrttasks20:45:121
1021899782,23cyclictest3000-21latency_hist20:20:011
1021899782,23cyclictest21278-21grep19:35:261
1021899782,21cyclictest29263-21/usr/sbin/munin20:00:241
10214997858,14cyclictest15503-21latency_hist22:50:010
1022799772,34cyclictest19263-21/usr/sbin/munin19:30:152
1021899774,23cyclictest12378-21fschecks_count19:10:101
1021899774,21cyclictest15387-21modprobe19:19:581
1021899773,32cyclictest352-21runrttasks20:30:231
1021899773,22cyclictest4650-21/usr/sbin/munin20:25:061
1021899773,22cyclictest4650-21/usr/sbin/munin20:25:061
1021899772,33cyclictest30179-21/usr/sbin/munin22:20:361
1021899772,23cyclictest27199-21apt-get19:55:101
10214997748,20cyclictest23718-21sort21:15:010
10233997614,40cyclictest0-21swapper/300:25:173
10233997614,40cyclictest0-21swapper/300:25:173
1021899763,33cyclictest694-21/usr/sbin/munin22:25:251
1021899763,29cyclictest9331-21latency_hist20:40:001
1021899763,24cyclictest26985-21/usr/sbin/munin21:20:131
1021899763,23cyclictest22186-21/usr/sbin/munin23:55:151
1021899763,22cyclictest22767-21grep19:40:231
1021899763,22cyclictest22767-21grep19:40:231
1021899763,22cyclictest18154-21latency21:05:241
1021899763,21cyclictest30822-21taskset23:15:201
1021899763,21cyclictest30822-21taskset23:15:201
1021899763,11cyclictest0-21swapper/119:50:561
1021899762,23cyclictest23970-21sshd19:45:131
1021899762,23cyclictest23970-21sshd19:45:131
10214997657,14cyclictest298-21in:imuxsock20:55:140
10214997646,21cyclictest9233-21cron20:39:570
10214997645,26cyclictest0-21swapper/023:30:240
1021899752,24cyclictest9735-21ssh21:45:211
1021899752,22cyclictest14734-21tr20:55:221
10214997560,9cyclictest4079-21rm22:30:210
10214997557,10cyclictest360-21/usr/sbin/munin21:30:280
10214997556,13cyclictest17340-21diskmemload21:40:350
10214997556,13cyclictest17340-21diskmemload21:40:350
10214997541,28cyclictest5656-21timerwakeupswit00:20:320
10214997458,11cyclictest14897-21ssh23:42:280
10214997458,10cyclictest17340-21diskmemload23:00:310
10214997457,11cyclictest20205-21ssh23:50:420
10214997357,10cyclictest10205-21cyclictest22:25:200
10214997356,11cyclictest277-21dbus-daemon23:19:590
10214997356,11cyclictest277-21dbus-daemon23:19:590
10214997336,23cyclictest181rcu_preempt19:35:350
10214997257,9cyclictest10205-21cyclictest21:35:200
10214997257,10cyclictest27464-21fschecks_time19:55:210
10214997256,10cyclictest27982-21ssh22:15:320
10214997253,13cyclictest22415-21sort19:40:140
10214997253,13cyclictest22415-21sort19:40:140
10214997252,14cyclictest17651-21sh21:59:040
10214997252,13cyclictest10868-21idleruntime-cro20:44:570
10214997157,9cyclictest6332-21kworker/u17:0+xprtiod22:58:060
10214997157,10cyclictest10205-21cyclictest19:26:120
10214997156,10cyclictest27094-21ssh21:20:160
10214997154,11cyclictest2373-21ssh23:21:290
10214997139,9cyclictest0-21swapper/019:24:580
10214997051,13cyclictest4619-21latency_hist00:20:000
10214997045,19cyclictest14594-21ntp_states19:15:280
10214997041,22cyclictest17963-21kworker/u17:1+nfsiod22:01:300
10214997041,22cyclictest17963-21kworker/u17:1+nfsiod22:01:300
1021499703,53cyclictest22411-21basename23:55:220
1023399693,56cyclictest23996-21chrt21:15:213
10214996956,8cyclictest29924-21kworker/u17:0+rpciod21:50:330
10214996953,10cyclictest30240-21ssh21:25:200
10214996953,10cyclictest30240-21ssh21:25:200
10214996952,10cyclictest31789-21apt-key20:09:590
10214996947,15cyclictest20313-21sh21:09:580
10214996941,21cyclictest10201-21kworker/u17:4+nfsiod00:32:260
1021499683,37cyclictest4910-21fschecks_time20:25:170
1021499683,37cyclictest4910-21fschecks_time20:25:170
1023399677,38cyclictest0-21swapper/323:20:133
1021499673,34cyclictest6648-21/usr/sbin/munin22:35:240
10214996647,12cyclictest300-21rs:main0
10214996645,15cyclictest20485-21tr19:34:580
10214996637,20cyclictest6332-21kworker/u17:0+nfsiod22:51:010
10214996637,20cyclictest6332-21kworker/u17:0+nfsiod22:51:010
1021499663,35cyclictest9447-21sort21:45:130
1021499663,35cyclictest3126-21sort20:20:140
1021499663,35cyclictest3126-21sort20:20:140
1023399658,39cyclictest0-21swapper/300:15:253
10214996548,10cyclictest6648-21ssh23:29:230
10214996537,24cyclictest30436-21kworker/u19:0-events_unbound22:23:160
1021499653,36cyclictest352-21runrttasks22:44:300
1021499653,36cyclictest352-21runrttasks22:44:300
1021499653,32cyclictest25015-21grep21:15:490
10233996445,13cyclictest451rcuc/322:35:083
10214996444,14cyclictest26911-21sendmail19:54:570
10214996443,16cyclictest2880-21latency_hist20:20:000
10214996442,15cyclictest11205-21grep19:05:310
1021499643,49cyclictest6882-21processes20:30:300
10214996345,11cyclictest26005-21unixbench_multi00:00:320
1021499624,43cyclictest29563-21switchtime20:00:310
10214996244,12cyclictest28769-21ssh00:05:300
10214996244,12cyclictest28769-21ssh00:05:300
10214996243,12cyclictest13754-21cron19:14:580
1021499623,33cyclictest24404-21df22:10:150
10214996233,21cyclictest11518-21wc20:45:230
1023399604,42cyclictest8864-21chrt20:35:313
10233996014,28cyclictest0-21swapper/323:54:583
1023399574,36cyclictest22580-21taskset19:40:193
1023399574,36cyclictest22580-21taskset19:40:193
1023399573,42cyclictest16206-21chrt22:50:273
1023399573,42cyclictest16206-21chrt22:50:273
1023399564,38cyclictest30498-21taskset21:25:263
1023399564,38cyclictest30498-21taskset21:25:263
1023399564,37cyclictest9330-21taskset21:45:073
1023399564,36cyclictest1523-21taskset00:15:013
1023399563,39cyclictest12665-21chrt19:10:223
1023399555,36cyclictest13645-21taskset00:34:593
1023399553,42cyclictest16559-21chrt21:00:303
1023399545,36cyclictest18951-21taskset23:50:003
1023399543,38cyclictest13188-21chrt22:45:253
1023399543,37cyclictest21095-21chrt21:10:223
1023399543,37cyclictest19040-21taskset21:06:213
1023399534,36cyclictest27232-21chrt21:20:193
1023399533,37cyclictest27798-21chrt22:15:263
1023399533,37cyclictest23837-21taskset22:09:473
1023399533,37cyclictest23837-21taskset22:09:473
1023399533,36cyclictest15413-21chrt19:19:583
1023399533,24cyclictest0-21swapper/319:25:123
1023399532,41cyclictest5850-21taskset21:39:243
1023399532,38cyclictest30580-21chrt00:09:503
1023399532,38cyclictest30580-21chrt00:09:503
1023399523,40cyclictest2846-21taskset22:28:313
1023399523,38cyclictest4748-21chrt22:30:343
1023399523,38cyclictest31290-21taskset23:15:313
1023399523,38cyclictest31290-21taskset23:15:313
1023399523,37cyclictest29975-21taskset23:14:303
1023399523,37cyclictest13298-21chrt20:50:293
1023399523,36cyclictest21132-21taskset22:05:013
1023399523,36cyclictest21132-21taskset22:05:013
1023399515,32cyclictest14634-21chrt20:55:193
1023399513,37cyclictest32589-21taskset22:24:133
1023399513,34cyclictest7071-21taskset20:30:333
1023399513,33cyclictest29262-21chrt20:00:243
1023399513,33cyclictest1183-21chrt20:14:583
1023399512,34cyclictest6930-21chrt00:23:483
1023399504,38cyclictest6565-21chrt21:40:173
1023399504,38cyclictest6565-21chrt21:40:173
1023399504,33cyclictest7253-21chrt23:30:153
1023399504,31cyclictest28401-21taskset19:58:133
1023399504,31cyclictest25319-21chrt00:00:183
1023399503,34cyclictest21628-21chrt19:35:333
1023399503,33cyclictest10980-21chrt19:05:283
1023399502,39cyclictest13899-21chrt21:51:563
1023399502,38cyclictest11157-21taskset22:41:443
1023399502,38cyclictest11157-21taskset22:41:443
1023399493,35cyclictest24939-21taskset23:05:223
1023399493,34cyclictest4419-21chrt20:24:583
1023399493,34cyclictest4419-21chrt20:24:583
1023399493,33cyclictest22392-21taskset23:00:323
1023399493,33cyclictest18986-21chrt22:55:213
1023399493,33cyclictest14846-21chrt23:42:193
1023399493,33cyclictest12684-21chrt23:39:353
1023399493,33cyclictest12684-21chrt23:39:353
1023399492,33cyclictest25360-21chrt22:10:403
1023399492,33cyclictest1563-21chrt20:15:263
1023399484,34cyclictest11532-21taskset20:45:233
1023399483,36cyclictest23717-21chrt23:57:103
1023399483,32cyclictest15694-21chrt21:55:203
1023399483,31cyclictest5230-21chrt20:25:273
1023399483,31cyclictest5230-21chrt20:25:273
1023399482,32cyclictest19807-21chrt19:30:313
1023399472,35cyclictest2450-21taskset21:33:163
1023399463,29cyclictest31399-21taskset20:05:343
1023399453,33cyclictest5871-21chrt23:27:113
1023399452,27cyclictest27166-21chrt19:55:013
1023399443,31cyclictest9558-21taskset20:40:133
10233994012,17cyclictest0-21swapper/319:49:573
10233994012,17cyclictest0-21swapper/319:49:573
10233994010,17cyclictest0-21swapper/319:25:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional