You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 02:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Apr 22, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16480217110,27sleep20-21swapper/218:58:032
16668212911,76sleep18637-21kworker/u18:1+ext4-rsv-conversion18:58:351
17920991172,45cyclictest2731-21apt-get19:52:550
17920991172,45cyclictest2731-21apt-get19:52:550
17920991103,42cyclictest7560-21apt-get20:07:530
179209910954,49cyclictest297-21systemd-logind19:07:420
179209910954,49cyclictest297-21systemd-logind19:07:420
17920991095,27cyclictest14672-21/usr/sbin/munin22:33:200
17920991073,36cyclictest27131-21latency_hist23:47:440
179209910643,56cyclictest0-21swapper/021:17:410
17920991063,33cyclictest17918-21cyclictest19:02:460
179309910577,19cyclictest25060-21diskmemload00:23:061
179209910536,61cyclictest0-21swapper/023:37:560
17920991053,37cyclictest352-21runrttasks00:16:020
17920991047,16cyclictest9360-21ssh23:18:090
17920991043,21cyclictest19695-21cut00:28:380
17920991033,32cyclictest20147-21/usr/sbin/munin19:08:190
17920991033,32cyclictest20147-21/usr/sbin/munin19:08:190
17920991033,31cyclictest30727-21ssh22:04:170
17920991033,31cyclictest30727-21ssh22:04:170
179209910313,12cyclictest0-21swapper/021:23:160
17920991024,32cyclictest31727-21latency_hist19:42:430
17920991023,29cyclictest15855-21fschecks_count20:33:030
17920991023,13cyclictest0-21swapper/000:08:310
17920991023,13cyclictest0-21swapper/000:08:310
17920991022,32cyclictest15168-21/usr/sbin/munin23:28:190
17920991014,39cyclictest28238-21sendmail-msp19:32:420
17920991013,32cyclictest1078-21/usr/sbin/munin19:48:160
17920991013,31cyclictest20823-21sendmail_mailst21:48:160
17920991013,30cyclictest352-21runrttasks22:47:350
179209910110,11cyclictest0-21swapper/021:12:060
179209910110,11cyclictest0-21swapper/021:12:060
17920991004,31cyclictest13281-21/usr/sbin/munin00:18:030
17920991004,31cyclictest13281-21/usr/sbin/munin00:18:030
17920991003,40cyclictest26717-21latency_hist19:27:440
17920991003,32cyclictest12561-21taskset23:23:040
1792099994,28cyclictest352-21runrttasks21:34:520
1792099992,39cyclictest24247-21/usr/sbin/munin22:48:140
17920999847,45cyclictest25456-21ssh21:03:000
1792099984,39cyclictest6390-21ntp_states22:18:130
1792099984,30cyclictest14115-21/usr/sbin/munin21:38:410
1792099983,46cyclictest2525-21ssh22:12:430
1792099983,36cyclictest30322-21/usr/sbin/munin23:53:020
1792099983,31cyclictest32201-21cron23:02:400
1792099983,31cyclictest32201-21cron23:02:400
1792099982,31cyclictest2935-21ls21:18:180
1792099982,24cyclictest17289-21ssh21:43:000
17930999767,19cyclictest26479-21latency_hist22:52:441
1792099973,25cyclictest8492-21/usr/sbin/munin21:28:100
1792099964,33cyclictest6106-21cpu23:12:580
17920999639,52cyclictest0-21swapper/023:58:040
17920999637,51cyclictest0-21swapper/023:33:030
1792099963,31cyclictest3815-21/usr/sbin/munin00:03:000
1792099963,31cyclictest3815-21/usr/sbin/munin00:03:000
1792099963,31cyclictest14190-21fschecks_count20:28:040
1792099963,20cyclictest28060-21runrttasks22:00:070
17920999622,67cyclictest0-21swapper/022:28:030
17920999622,67cyclictest0-21swapper/022:28:030
1792099954,29cyclictest436-21head19:43:180
17920999534,54cyclictest339-21cut23:03:030
1792099953,35cyclictest352-21runrttasks19:32:520
1792099953,30cyclictest23520-21ssh21:53:070
1792099952,39cyclictest352-21runrttasks22:37:470
1792099952,33cyclictest23534-21latency_hist20:57:430
1792099952,29cyclictest5455-21idleruntime-cro22:17:410
1792099952,29cyclictest5455-21idleruntime-cro22:17:410
17931999470,16cyclictest26041-21latency_hist21:57:442
1793099942,66cyclictest21460-21dpkg23:38:071
1792099943,32cyclictest3036-21/usr/sbin/munin23:08:160
1792099942,21cyclictest16459-21latency00:23:060
1792099939,11cyclictest0-21swapper/023:52:440
1792099933,32cyclictest20673-21grep20:48:030
1792099933,31cyclictest11230-21latency20:18:080
1792099933,30cyclictest14176-21kworker/u18:2+flush-179:019:13:030
1792099933,29cyclictest12622-21fschecks_count20:23:030
1792099933,10cyclictest0-21swapper/022:23:000
1792099925,35cyclictest6781-21timerwakeupswit20:03:170
1792099925,35cyclictest6781-21timerwakeupswit20:03:170
1792099923,25cyclictest19076-21fschecks_count20:43:040
1792099923,25cyclictest19076-21fschecks_count20:43:040
17920999231,55cyclictest17669-21sort20:38:060
1792099922,32cyclictest4614-21fschecks_time19:58:050
1792099922,32cyclictest4614-21fschecks_time19:58:050
1792099922,32cyclictest26893-21sh22:53:030
17931999150,13cyclictest181rcu_preempt20:23:032
1792099914,27cyclictest25074-21latency_hist19:22:440
1792099913,29cyclictest9183-21/usr/sbin/munin20:13:160
1793199907,42cyclictest13591-21apt-get21:38:072
1792099903,31cyclictest24622-21grep20:58:190
17931998965,15cyclictest17651-21rm22:37:522
1793099893,73cyclictest13591-21apt-get21:37:561
1793099863,51cyclictest954-21ssh23:03:171
17931998460,18cyclictest28344-21apt-key19:32:442
17931998454,20cyclictest4657-21switchtime00:03:172
17931998454,20cyclictest4657-21switchtime00:03:172
17930998464,13cyclictest2374-21systemd-journal21:46:461
17931998363,14cyclictest8418-21sh22:22:412
17931998353,21cyclictest484-21kworker/u18:0+events_unbound20:52:412
17930998365,11cyclictest26204-21apt-key21:57:461
17931998255,19cyclictest22085-21kworker/u19:2+nfsiod00:22:152
17931998255,19cyclictest22085-21kworker/u19:2+nfsiod00:22:152
17931998246,13cyclictest181rcu_preempt00:13:092
17930998259,15cyclictest30569-21unixbench_multi22:58:191
17930998259,15cyclictest30569-21unixbench_multi22:58:191
17931998163,12cyclictest25060-21diskmemload22:58:052
17931998163,12cyclictest25060-21diskmemload22:58:052
17930998165,10cyclictest8749-21apt-key23:17:421
17930998159,15cyclictest17918-21cyclictest00:08:331
17930998159,15cyclictest17918-21cyclictest00:08:331
1793199803,40cyclictest26325-21apt-get21:58:432
1793099808,60cyclictest9260-21apt-get23:18:001
17930998058,16cyclictest26873-21cpu19:27:591
17930997960,11cyclictest277-21dbus-daemon19:12:421
17930997960,11cyclictest277-21dbus-daemon19:12:421
17931997858,12cyclictest58-21kcompactd019:18:082
17931997854,15cyclictest20013-21latency19:07:532
17931997854,15cyclictest20013-21latency19:07:532
17931997849,12cyclictest0-21swapper/220:38:062
17930997861,11cyclictest854-21systemd-run19:47:421
17930997859,11cyclictest17918-21cyclictest23:50:471
17930997858,14cyclictest21679-21sh00:32:401
17930997858,14cyclictest20950-21apt-key23:37:441
17930997857,14cyclictest300-21rs:main1
17930997857,14cyclictest300-21rs:main1
17931997748,10cyclictest181rcu_preempt23:57:582
17930997754,16cyclictest13246-21fschecks_count00:18:031
17930997754,16cyclictest13246-21fschecks_count00:18:031
17930997718,20cyclictest0-21swapper/122:33:161
17931997659,10cyclictest17332-21modprobe22:37:412
17931997652,19cyclictest14169-21kworker/u17:3+events_unbound23:37:462
17931997642,10cyclictest181rcu_preempt00:11:322
17931997642,10cyclictest181rcu_preempt00:11:322
17931997640,8cyclictest24739-21ssh23:43:062
17931997639,7cyclictest181rcu_preempt23:14:432
17931997621,17cyclictest28887-21cat21:08:092
17931997621,17cyclictest28887-21cat21:08:092
17930997660,11cyclictest17918-21cyclictest20:38:171
17930997655,15cyclictest4850-21latency_hist21:22:451
1793099763,59cyclictest28199-21apt-get19:32:561
17931997548,18cyclictest15840-21cut20:33:032
17931997546,15cyclictest181rcu_preempt20:17:442
17931997529,10cyclictest0-21swapper/219:43:022
17931997528,24cyclictest31681-21ls19:42:412
17930997560,10cyclictest29174-21mailstats21:08:171
17930997560,10cyclictest29174-21mailstats21:08:171
17930997559,11cyclictest17918-21cyclictest22:04:171
17930997559,11cyclictest17918-21cyclictest22:04:171
17932997435,32cyclictest0-21swapper/321:38:133
17931997456,12cyclictest15814-21ssh23:28:132
17931997445,20cyclictest20950-21apt-key23:37:442
17931997445,13cyclictest29331-21ssh23:50:512
17931997444,9cyclictest181rcu_preempt22:12:582
17931997444,9cyclictest181rcu_preempt22:12:582
17931997432,9cyclictest181rcu_preempt23:08:222
17930997454,14cyclictest25060-21diskmemload21:05:071
1793099742,64cyclictest21428-21kworker/u17:0+ext4-rsv-conversion21:57:571
17931997354,13cyclictest13096-21ssh21:36:202
17931997353,14cyclictest1-21systemd23:03:462
17931997346,10cyclictest181rcu_preempt19:47:572
1793199734,54cyclictest5125-21df21:22:592
17931997341,13cyclictest181rcu_preempt22:49:202
1793299722,37cyclictest214672sleep323:38:093
17931997252,15cyclictest17918-21cyclictest22:23:182
17931997250,15cyclictest18708-21processes19:03:132
17931997250,15cyclictest18708-21processes19:03:132
17931997242,21cyclictest15357-21sh20:32:422
1793199723,50cyclictest26730-21latency_hist19:27:442
17931997234,12cyclictest1466-21ssh21:17:082
17930997255,11cyclictest2374-21systemd-journal19:13:471
17930997255,11cyclictest19489-21systemd-run19:07:421
17930997255,11cyclictest19489-21systemd-run19:07:421
17930997254,12cyclictest21447-21switchtime22:43:141
17931997147,9cyclictest181rcu_preempt22:43:052
17931997146,8cyclictest181rcu_preempt00:29:342
17931997144,7cyclictest181rcu_preempt22:02:542
17931997144,7cyclictest181rcu_preempt22:02:542
17930997153,11cyclictest0-21swapper/120:33:021
17932997011,31cyclictest0-21swapper/321:58:003
17931997052,12cyclictest7619-21cpuspeed20:07:582
17931997051,10cyclictest0-21swapper/223:53:112
17931997038,17cyclictest181rcu_preempt22:32:332
17931997038,17cyclictest181rcu_preempt22:32:332
1793199703,48cyclictest3483-21threads19:53:162
1793199703,48cyclictest3483-21threads19:53:162
17930997054,10cyclictest0-21swapper/121:23:021
17930997052,11cyclictest0-21swapper/121:28:061
17931996945,13cyclictest0-21swapper/221:48:142
1793199693,47cyclictest6013-21cpuspeed20:02:582
1793199693,47cyclictest6013-21cpuspeed20:02:582
17931996931,12cyclictest19040-21latency_hist00:27:452
1793199692,36cyclictest2795-21grep21:18:162
17930996953,11cyclictest4151-21users23:08:191
17930996949,15cyclictest21428-21kworker/u17:0+events_unbound21:52:421
17930996948,14cyclictest297-21systemd-logind20:32:421
17931996845,8cyclictest181rcu_preempt20:58:082
17931996838,21cyclictest1-21systemd23:22:422
1793199683,46cyclictest28292-21latency_hist21:07:442
17930996850,14cyclictest12119-21kworker/u17:3+events_unbound20:52:411
17930996844,16cyclictest0-21swapper/120:47:431
17930996844,16cyclictest0-21swapper/120:47:431
17930996829,30cyclictest7282-21modprobe20:07:411
17930996829,30cyclictest7282-21modprobe20:07:411
17930996819,11cyclictest291rcuc/122:23:101
17931996747,13cyclictest0-21swapper/219:34:142
17931996737,11cyclictest181rcu_preempt22:08:162
1793199673,38cyclictest19773-21modprobe21:47:412
17930996748,15cyclictest17866-21kworker/u19:3+events_unbound19:42:411
17930996748,13cyclictest3633-21switchtime22:13:171
17930996748,13cyclictest3633-21switchtime22:13:171
17930996748,11cyclictest0-21swapper/119:23:181
17930996746,15cyclictest1-21systemd20:15:471
1793099672,45cyclictest18427-21ssh22:38:151
1793099672,27cyclictest10211-21cstates00:12:591
17931996632,16cyclictest181rcu_preempt20:20:352
17931996631,13cyclictest181rcu_preempt23:23:102
17931996628,15cyclictest181rcu_preempt20:53:172
17930996651,10cyclictest17918-21cyclictest20:58:191
17930996651,10cyclictest17918-21cyclictest00:05:271
17930996651,10cyclictest17918-21cyclictest00:05:271
17930996647,13cyclictest25060-21diskmemload23:23:171
17930996644,16cyclictest1819-21timerwakeupswit23:58:191
17930996641,17cyclictest0-21swapper/121:13:061
1793099662,47cyclictest16301-21users23:28:231
17931996541,10cyclictest181rcu_preempt21:27:582
1793199653,31cyclictest5690-21munin-run20:02:412
1793199653,31cyclictest5690-21munin-run20:02:412
17931996528,12cyclictest181rcu_preempt19:13:112
17930996519,39cyclictest0-21swapper/122:07:571
17931996431,9cyclictest181rcu_preempt20:43:172
17931996431,9cyclictest181rcu_preempt20:43:172
17930996424,7cyclictest291rcuc/120:18:001
1793299634,43cyclictest17948-21taskset22:38:033
17931996344,11cyclictest0-21swapper/222:53:092
17930996346,11cyclictest27842-21ssh22:53:421
1793099634,38cyclictest23747-21cstates19:17:581
1793099634,33cyclictest352-21runrttasks20:08:361
1793099633,46cyclictest31020-21proc_pri23:53:161
1793099633,43cyclictest13189-21timerandwakeup20:23:161
1793099633,32cyclictest11803-21timerandwakeup21:33:191
1793099632,40cyclictest5711-21sshd22:17:461
17930996313,41cyclictest0-21swapper/120:52:571
17930996312,18cyclictest25060-21diskmemload23:45:261
1793099624,39cyclictest1348-21fschecks_time19:48:041
1793299614,40cyclictest0-21swapper/323:17:583
17932996141,12cyclictest0-21swapper/319:12:593
1793099613,37cyclictest3102-21kernelversion19:53:071
1793099613,37cyclictest3102-21kernelversion19:53:071
1793099602,42cyclictest4517-21fschecks_count19:58:041
1793099602,42cyclictest4517-21fschecks_count19:58:041
1793299593,38cyclictest13945-21taskset20:27:453
1793299584,41cyclictest29417-21chrt19:34:113
1793299584,39cyclictest5174-21taskset23:11:103
1793299583,40cyclictest14537-21chrt22:32:453
1793299583,40cyclictest14537-21chrt22:32:453
1793299583,39cyclictest7844-21chrt20:08:053
1793299565,37cyclictest18130-21chrt19:02:523
1793299565,37cyclictest18130-21chrt19:02:523
1793299564,40cyclictest28530-21chrt19:32:453
1793299563,38cyclictest30747-21taskset23:53:063
1793299563,36cyclictest28804-21taskset22:56:273
17932995628,20cyclictest20303-21chrt21:48:023
17932995611,27cyclictest0-21swapper/300:08:053
17932995611,27cyclictest0-21swapper/300:08:053
1793299553,41cyclictest30719-21taskset22:04:163
1793299553,41cyclictest30719-21taskset22:04:163
1793299553,37cyclictest8557-21chrt22:22:443
1793299553,35cyclictest26093-21chrt21:03:173
1793299544,36cyclictest3814-21chrt00:02:513
1793299544,36cyclictest3814-21chrt00:02:513
1793299543,37cyclictest19231-21chrt00:28:003
1793299543,36cyclictest7472-21chrt20:07:443
1793299543,36cyclictest7472-21chrt20:07:443
1793299543,34cyclictest32440-21chrt22:08:013
1793299533,38cyclictest11388-21chrt21:33:073
1793299533,37cyclictest22869-21taskset20:53:163
1793299533,34cyclictest361-21taskset23:03:033
1793299533,32cyclictest19077-21chrt00:27:453
1793299532,38cyclictest30833-21chrt21:12:003
1793299532,38cyclictest30833-21chrt21:12:003
1793299532,37cyclictest12891-21taskset23:23:143
1793299523,37cyclictest15057-21chrt22:33:053
1793299523,33cyclictest23297-21chrt21:53:013
1793299522,35cyclictest23765-21chrt22:48:003
1793299522,33cyclictest10718-21chrt20:17:453
1793299513,38cyclictest31404-21taskset23:00:243
1793299513,38cyclictest31404-21taskset23:00:243
1793299513,37cyclictest2459-21taskset19:52:423
1793299513,35cyclictest5433-21chrt22:17:413
1793299513,35cyclictest5433-21chrt22:17:413
1793299512,37cyclictest15210-21chrt00:21:243
1793299512,37cyclictest15210-21chrt00:21:243
1793299512,34cyclictest15904-21chrt20:33:033
1793299504,32cyclictest15447-21chrt23:28:043
1793299502,37cyclictest4880-21chrt19:58:133
1793299502,37cyclictest4880-21chrt19:58:133
1793299502,34cyclictest18213-21chrt23:32:583
1793299494,35cyclictest19090-21taskset20:43:043
1793299494,35cyclictest19090-21taskset20:43:043
1793299494,30cyclictest24370-21chrt19:18:153
1793299493,37cyclictest3520-21chrt21:19:303
1793299493,34cyclictest1492-21chrt23:58:133
1793299493,33cyclictest11285-21chrt00:13:423
1793299493,32cyclictest5082-21taskset21:22:583
1793299492,34cyclictest8732-21chrt22:22:523
1793299492,33cyclictest1090-21chrt21:16:053
1793299483,33cyclictest881-21chrt19:47:443
1793299482,34cyclictest7558-21chrt23:14:263
1793299482,34cyclictest25255-21taskset19:22:533
1793299474,32cyclictest23730-21chrt20:57:583
1793299473,34cyclictest27069-21chrt23:47:433
1793299473,34cyclictest14554-21chrt20:28:143
1793299473,31cyclictest11828-21chrt20:18:463
1793299472,33cyclictest31141-21chrt19:38:163
17932994711,23cyclictest27545-21chrt23:48:003
178602476,22sleep30-21swapper/319:02:453
1793299463,34cyclictest2747-21chrt19:52:583
1793299463,34cyclictest2747-21chrt19:52:583
1793299463,31cyclictest9570-21chrt21:29:513
1793299463,30cyclictest21948-21chrt20:52:443
1793299462,34cyclictest23368-21chrt22:47:443
1793299443,28cyclictest20313-21chrt19:08:033
1793299443,28cyclictest20313-21chrt19:08:033
1793299432,33cyclictest17733-21chrt21:43:123
1793299402,27cyclictest17258-21chrt20:37:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional