You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 03:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sun Jul 05, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3963220415,68sleep24008-21awk18:57:422
41339911931,43cyclictest0-21swapper/122:32:561
3663211210,20sleep00-21swapper/018:53:450
41379911155,11cyclictest277-21dbus-daemon22:07:422
4129991047,80cyclictest5272-21apt-get23:27:580
4129991033,69cyclictest3414-21ssh21:37:590
4133991013,75cyclictest7215-21apt-get22:38:051
41339910125,39cyclictest26845-21tune2fs21:23:041
4137999913,76cyclictest5859-21ssh23:29:062
412999998,79cyclictest3317-21apt-get00:17:550
413399983,69cyclictest3395-21chrt00:18:051
290229711,59sleep12930-21/usr/sbin/munin18:53:091
412999955,70cyclictest8498-21apt-get23:33:010
4133999326,36cyclictest18677-21fschecks_time22:03:041
412999933,50cyclictest15-21ksoftirqd/000:26:380
412999933,50cyclictest15-21ksoftirqd/000:26:380
4137999210,69cyclictest3354-21apt-get21:38:442
4133999262,23cyclictest352-21runrttasks00:23:191
4133999262,23cyclictest352-21runrttasks00:23:191
4133999231,23cyclictest1999-21rm21:35:271
4133999231,23cyclictest1999-21rm21:35:271
4133999162,18cyclictest24314-21latency_hist22:12:441
412999905,76cyclictest18123-21kworker/u18:3+ext4-rsv-conversion22:38:080
4137998910,70cyclictest8478-21/usr/sbin/munin23:34:032
4133998932,27cyclictest31774-21seq00:11:281
4133998923,28cyclictest0-21swapper/119:32:391
413399886,57cyclictest21922-21apt-get23:02:561
413399886,57cyclictest21922-21apt-get23:02:561
4133998863,16cyclictest20834-21fschecks_time23:53:041
4133998826,25cyclictest0-21swapper/122:20:511
4133998822,34cyclictest15044-21ntpq23:43:081
412999889,45cyclictest15-21ksoftirqd/022:56:010
412999889,45cyclictest15-21ksoftirqd/022:56:010
4137998771,10cyclictest14240-21modprobe21:02:412
4133998729,25cyclictest17047-21seq19:33:401
4133998729,23cyclictest27108-21seq20:05:281
4133998724,22cyclictest0-21swapper/120:17:471
4133998720,29cyclictest0-21swapper/123:13:041
4133998630,28cyclictest11250-21diskmemload21:52:411
4133998630,28cyclictest11250-21diskmemload21:52:411
4133998626,26cyclictest32278-21sh21:32:411
4133998626,26cyclictest21887-21seq23:02:371
4133998625,28cyclictest6663-21grep20:43:041
4133998625,28cyclictest6663-21grep20:43:041
4133998624,25cyclictest6451-21cat23:29:241
4133998623,26cyclictest2828-21munin-run00:17:431
4133998623,23cyclictest0-21swapper/119:15:011
4133998623,23cyclictest0-21swapper/119:15:011
4133998622,34cyclictest15657-21unixbench_singl21:03:201
4129998611,42cyclictest870-21mailstats21:33:140
4129998611,42cyclictest870-21mailstats21:33:140
4133998542,29cyclictest17641-21apt-get19:37:541
4133998532,19cyclictest300-21rs:main1
4133998531,19cyclictest20295-21seq19:44:091
4133998529,23cyclictest1032-21seq20:24:321
4133998524,29cyclictest6656-21tune2fs21:43:031
4133998523,21cyclictest0-21swapper/120:10:341
4133998523,21cyclictest0-21swapper/120:10:341
4133998521,27cyclictest5407-21runrttasks18:59:541
4133998460,16cyclictest4120-21cyclictest20:49:021
4133998459,16cyclictest14342-21sh23:42:451
4133998459,16cyclictest14342-21sh23:42:451
4133998452,23cyclictest13490-21grep19:23:151
4133998431,20cyclictest30316-21seq20:15:041
4133998431,20cyclictest30316-21seq20:15:041
4133998430,27cyclictest352-21runrttasks22:27:551
4133998425,26cyclictest0-21swapper/121:17:181
4133998424,24cyclictest8995-21ssh23:34:031
4133998420,30cyclictest0-21swapper/123:58:161
414299834,44cyclictest0-21swapper/323:33:543
4137998362,14cyclictest11250-21diskmemload23:38:002
4137998362,14cyclictest11250-21diskmemload23:38:002
4137998341,14cyclictest18479-21ssh22:56:292
4137998341,14cyclictest18479-21ssh22:56:292
4137998327,28cyclictest4684-21ssh00:19:372
4133998327,23cyclictest23795-21seq19:57:261
4133998326,27cyclictest17106-21find22:53:181
4133998326,27cyclictest17106-21find22:53:181
4133998324,25cyclictest16339-21grep21:58:171
4133998323,24cyclictest106612awk20:53:221
4133998323,24cyclictest106612awk20:53:221
4133998321,28cyclictest0-21swapper/121:38:581
4129998363,14cyclictest21091-21latency_hist22:07:430
4129998355,19cyclictest6661-21latency_hist22:37:450
412999835,44cyclictest15-21ksoftirqd/021:26:010
412999832,39cyclictest15-21ksoftirqd/022:18:140
4137998268,7cyclictest0-21swapper/219:02:412
4133998238,37cyclictest0-21swapper/100:02:521
4133998227,23cyclictest9089-21seq19:09:591
4133998227,23cyclictest9089-21seq19:09:591
4133998225,25cyclictest26362-21latency_hist21:22:431
4133998223,22cyclictest0-21swapper/122:50:421
4133998222,29cyclictest31045-21ssh22:23:111
4133998222,29cyclictest31045-21ssh22:23:111
4133998221,28cyclictest0-21swapper/119:18:181
4133998219,28cyclictest0-21swapper/123:08:011
412999826,37cyclictest15-21ksoftirqd/019:57:380
412999823,71cyclictest22645-21ssh23:03:220
412999823,71cyclictest22645-21ssh23:03:220
4129998214,58cyclictest8305-21runrttasks20:48:090
4129998212,39cyclictest15-21ksoftirqd/019:35:470
4137998162,12cyclictest11085-21ntpd21:37:412
4137998162,12cyclictest11085-21ntpd21:37:412
4137998149,9cyclictest181rcu_preempt19:03:112
4137998149,9cyclictest181rcu_preempt19:03:112
4137998143,8cyclictest181rcu_preempt00:08:412
413799812,48cyclictest6672-21apt-get22:37:562
4133998128,20cyclictest1-21systemd19:50:121
4133998128,20cyclictest1-21systemd19:50:121
4133998127,23cyclictest5990-21seq20:40:561
4133998127,23cyclictest5990-21seq20:40:561
412999813,53cyclictest17184-40ogrotate23:47:410
412999813,47cyclictest15-21ksoftirqd/023:48:070
4129998111,41cyclictest15-21ksoftirqd/022:42:530
414299804,59cyclictest24359-21chrt19:58:063
4137998059,13cyclictest9131-21latency_hist00:27:442
4137998059,13cyclictest9131-21latency_hist00:27:442
4137998059,13cyclictest23205-21sh23:57:402
4133998047,23cyclictest1580-21apt-get20:27:531
4133998032,24cyclictest3375-21seq23:24:021
4133998032,24cyclictest3375-21seq23:24:021
4133998023,28cyclictest18156-21ntp_states23:48:141
4133998019,25cyclictest0-21swapper/122:43:071
412999804,40cyclictest15-21ksoftirqd/019:37:570
4129998043,9cyclictest181rcu_preempt21:29:520
4137997939,10cyclictest181rcu_preempt22:13:122
4137997939,10cyclictest181rcu_preempt22:13:122
4133997922,23cyclictest1-21systemd21:02:421
4129997949,14cyclictest181rcu_preempt20:42:440
4129997949,14cyclictest181rcu_preempt20:42:440
4129997945,10cyclictest181rcu_preempt20:47:390
4129997945,10cyclictest181rcu_preempt20:47:390
4129997937,16cyclictest181rcu_preempt19:23:050
412999792,37cyclictest15-21ksoftirqd/019:48:150
412999792,37cyclictest15-21ksoftirqd/019:48:150
4129997918,32cyclictest15-21ksoftirqd/021:07:460
4137997846,9cyclictest181rcu_preempt23:07:542
4137997830,14cyclictest32142-21latency_hist20:22:442
4137997753,17cyclictest352-21runrttasks23:22:432
4133997761,9cyclictest23259-21kworker/u17:2-rpciod23:18:031
4133997731,24cyclictest7583-21seq19:06:341
4133997731,24cyclictest7583-21seq19:06:341
4133997721,25cyclictest4543-21munin-run20:37:411
4129997758,13cyclictest11942-21latency23:38:060
4129997758,13cyclictest11942-21latency23:38:060
4129997754,16cyclictest544-21cron22:02:410
4129997753,9cyclictest181rcu_preempt20:57:570
4129997753,15cyclictest19501-21fschecks_time22:58:000
412999772,46cyclictest15-21ksoftirqd/021:12:570
4129997717,33cyclictest15-21ksoftirqd/019:18:290
4137997658,9cyclictest0-21swapper/222:22:512
4137997658,9cyclictest0-21swapper/222:22:512
413799762,62cyclictest18123-21kworker/u18:3+ext4-rsv-conversion23:03:022
413799762,62cyclictest18123-21kworker/u18:3+ext4-rsv-conversion23:03:022
4133997634,35cyclictest0-21swapper/121:52:551
4129997653,9cyclictest181rcu_preempt21:54:350
4129997650,11cyclictest181rcu_preempt19:14:490
4129997650,11cyclictest181rcu_preempt19:14:490
412999764,39cyclictest352-21runrttasks22:07:470
412999763,43cyclictest15-21ksoftirqd/019:03:000
412999763,43cyclictest15-21ksoftirqd/019:03:000
4129997631,12cyclictest181rcu_preempt19:59:260
412999762,45cyclictest15-21ksoftirqd/022:12:570
412999762,45cyclictest15-21ksoftirqd/022:12:570
412999762,43cyclictest15-21ksoftirqd/021:03:190
4129997619,27cyclictest15-21ksoftirqd/020:09:040
4129997619,27cyclictest15-21ksoftirqd/020:09:040
4137997554,15cyclictest2374-21systemd-journal00:06:202
4137997534,8cyclictest39-21ksoftirqd/220:13:172
4137997534,8cyclictest39-21ksoftirqd/220:13:172
4129997552,15cyclictest20911-21ssh23:53:060
412999754,42cyclictest15-21ksoftirqd/021:42:520
412999753,43cyclictest15-21ksoftirqd/020:17:130
412999753,43cyclictest15-21ksoftirqd/020:17:130
412999752,42cyclictest15-21ksoftirqd/022:32:440
4129997514,37cyclictest15-21ksoftirqd/019:45:590
352627510,40sleep30-21swapper/318:53:273
414299749,44cyclictest0-21swapper/323:27:553
4137997453,9cyclictest181rcu_preempt23:14:132
4137997447,19cyclictest22072-21latency_hist23:02:432
4137997439,16cyclictest181rcu_preempt19:53:122
412999748,38cyclictest15-21ksoftirqd/021:47:570
412999748,38cyclictest15-21ksoftirqd/021:47:570
4129997453,8cyclictest181rcu_preempt00:14:200
412999745,37cyclictest15-21ksoftirqd/020:54:370
412999745,37cyclictest15-21ksoftirqd/020:54:370
412999745,30cyclictest32357-21sed20:22:440
412999743,43cyclictest15-21ksoftirqd/023:15:070
4129997414,42cyclictest15-21ksoftirqd/019:12:410
4129997414,42cyclictest15-21ksoftirqd/019:12:410
4137997352,14cyclictest8196-21fschecks_time19:08:032
4137997352,14cyclictest8196-21fschecks_time19:08:032
413799734,31cyclictest4334-21ssh22:33:172
413799733,21cyclictest15048-21sendmail_mailqu19:28:142
4137997319,35cyclictest27473-21cat20:07:452
4133997329,22cyclictest19542-21ssh21:10:421
4133997315,27cyclictest0-21swapper/122:13:181
4133997315,27cyclictest0-21swapper/122:13:181
412999737,48cyclictest15-21ksoftirqd/022:22:450
412999737,48cyclictest15-21ksoftirqd/022:22:450
412999735,39cyclictest15-21ksoftirqd/020:05:520
4129997351,8cyclictest181rcu_preempt23:24:270
4129997351,8cyclictest181rcu_preempt23:24:270
4129997339,8cyclictest181rcu_preempt20:27:570
412999733,39cyclictest15-21ksoftirqd/020:33:010
412999732,44cyclictest15-21ksoftirqd/000:07:160
4129997316,36cyclictest15-21ksoftirqd/018:57:580
4129997310,34cyclictest15-21ksoftirqd/020:23:060
4137997256,10cyclictest21399-21ntp_offset19:48:102
4137997256,10cyclictest21399-21ntp_offset19:48:102
4137997252,13cyclictest170-21jbd2/mmcblk2p2-821:03:142
4137997249,14cyclictest15923-21modprobe22:52:412
4137997247,7cyclictest0-21swapper/220:23:152
4137997229,32cyclictest24785-21cat19:58:532
413799722,33cyclictest4901-21apt-key23:27:442
413799722,33cyclictest4901-21apt-key23:27:442
4137997215,12cyclictest0-21swapper/219:17:552
412999723,36cyclictest23556-21/usr/sbin/munin21:18:040
4129997232,12cyclictest181rcu_preempt00:12:340
413799716,40cyclictest27140-21ssh21:23:102
4137997152,14cyclictest10976-21latency_hist19:17:432
4137997152,14cyclictest10976-21latency_hist19:17:432
4137997141,12cyclictest1561-21/usr/sbin/munin20:27:562
4137997135,14cyclictest181rcu_preempt19:37:592
413799713,50cyclictest14287-21latency_hist19:27:442
4137997111,44cyclictest17177-21munin-run23:47:412
412999719,43cyclictest15-21ksoftirqd/023:22:430
4129997134,12cyclictest0-21swapper/000:02:430
412999713,34cyclictest25571-21cpuspeed23:07:560
413799706,42cyclictest28100-21/usr/sbin/munin22:18:162
4137997052,9cyclictest0-21swapper/221:13:032
4137997051,13cyclictest6780-21kernelversion20:43:082
4137997051,13cyclictest6780-21kernelversion20:43:082
4137997049,13cyclictest0-21swapper/221:48:192
4137997049,13cyclictest0-21swapper/221:48:192
4137997033,17cyclictest181rcu_preempt20:48:492
4129997010,36cyclictest15-21ksoftirqd/019:28:140
4137996946,16cyclictest14537-21journal-offline21:56:122
4137996942,18cyclictest0-21swapper/219:37:442
413799693,44cyclictest17832-21fschecks_time23:48:052
4129996955,9cyclictest3405-21kworker/u17:3+xprtiod22:48:060
4137996853,9cyclictest6669-21sh21:43:032
4137996845,7cyclictest181rcu_preempt22:46:392
413799684,44cyclictest1667-21processes22:28:142
4137996840,19cyclictest29006-21latency_hist20:12:432
4137996840,19cyclictest29006-21latency_hist20:12:432
4137996836,9cyclictest181rcu_preempt00:12:512
4142996742,12cyclictest123582sleep323:38:153
4142996742,12cyclictest123582sleep323:38:153
413799672,31cyclictest17838-21fschecks_count21:08:032
413799669,26cyclictest39-21ksoftirqd/220:57:422
413799669,26cyclictest39-21ksoftirqd/220:57:422
413799663,39cyclictest352-21runrttasks20:34:512
4137996625,15cyclictest181rcu_preempt22:07:572
4137996612,36cyclictest5587-21timerandwakeup20:38:212
4137996612,36cyclictest5587-21timerandwakeup20:38:212
413799661,20cyclictest23769-21ssh23:58:022
4137996443,16cyclictest24537-21timerwakeupswit21:18:182
413799643,43cyclictest15383-21/usr/sbin/munin21:58:052
413799643,40cyclictest29583-21/usr/sbin/munin21:28:082
12452640,7sleep30-21swapper/321:33:203
12452640,7sleep30-21swapper/321:33:203
413799633,27cyclictest39-21ksoftirqd/219:43:002
414299582,45cyclictest22357-21taskset21:15:113
414299543,41cyclictest21932-21chrt23:02:413
414299543,38cyclictest14433-21taskset23:42:453
414299543,37cyclictest30243-21taskset23:15:093
414299543,35cyclictest11521-21chrt20:57:483
414299542,37cyclictest2705-21chrt22:30:023
266632540,7sleep30-21swapper/323:08:283
414299533,40cyclictest5815-21chrt00:22:133
414299533,38cyclictest4424-21chrt23:26:563
414299533,38cyclictest4424-21chrt23:26:563
414299533,34cyclictest29719-21chrt00:07:583
414299533,32cyclictest5225-21taskset20:38:113
414299533,32cyclictest5225-21taskset20:38:113
4142995310,26cyclictest0-21swapper/321:37:593
414299529,28cyclictest0-21swapper/323:03:023
414299529,28cyclictest0-21swapper/323:03:023
414299523,36cyclictest1805-21taskset23:22:433
414299523,36cyclictest11330-21chrt20:57:443
414299523,36cyclictest11330-21chrt20:57:443
414299523,34cyclictest6889-21chrt22:37:443
4142995219,26cyclictest0-21swapper/320:48:093
414299513,39cyclictest30258-21chrt21:28:173
414299513,37cyclictest20413-21taskset21:12:443
414299513,37cyclictest16219-21chrt19:33:023
414299513,36cyclictest26316-21chrt00:02:433
414299513,35cyclictest24810-21chrt22:13:043
414299513,35cyclictest24810-21chrt22:13:043
414299513,34cyclictest11692-21chrt21:51:363
414299513,34cyclictest11692-21chrt21:51:363
414299512,35cyclictest28391-21taskset00:05:273
414299503,36cyclictest23579-21chrt22:11:143
414299503,35cyclictest12891-21chrt22:47:413
414299503,33cyclictest6703-21chrt20:43:063
414299503,33cyclictest6703-21chrt20:43:063
414299503,33cyclictest4560-21chrt18:58:033
414299503,33cyclictest12626-21chrt21:53:023
414299503,32cyclictest20761-21chrt19:47:453
414299494,31cyclictest24277-21taskset19:57:453
414299494,29cyclictest0-21swapper/322:38:003
414299493,35cyclictest29654-21chrt22:21:273
414299493,35cyclictest11596-21chrt19:18:083
414299492,37cyclictest9327-21chrt19:12:413
414299492,37cyclictest9327-21chrt19:12:413
414299492,36cyclictest6423-21taskset19:03:013
414299492,36cyclictest6423-21taskset19:03:013
414299483,34cyclictest15160-21chrt21:03:113
414299482,34cyclictest13792-21chrt22:48:103
414299474,30cyclictest10201-21chrt19:13:143
414299474,30cyclictest10201-21chrt19:13:143
414299473,31cyclictest6718-21chrt00:23:063
414299473,31cyclictest6718-21chrt00:23:063
414299473,30cyclictest28070-21chrt21:24:243
414299464,32cyclictest27310-21taskset20:07:413
414299463,34cyclictest31286-21chrt20:18:113
414299463,34cyclictest30099-21chrt20:13:173
414299463,34cyclictest30099-21chrt20:13:173
414299463,33cyclictest24366-21chrt21:18:163
414299453,32cyclictest19884-21chrt23:51:493
414299444,31cyclictest2869-21chrt20:32:123
414299442,33cyclictest32174-21chrt22:25:083
414299442,33cyclictest32174-21chrt22:25:083
414299433,30cyclictest17343-21chrt22:53:213
414299433,30cyclictest17343-21chrt22:53:213
414299433,29cyclictest15962-21taskset21:58:093
414299432,30cyclictest14039-21taskset19:26:383
414299423,27cyclictest6331-21taskset21:42:483
414299423,26cyclictest1026-21chrt00:13:173
414299423,25cyclictest22507-21chrt23:55:463
414299422,32cyclictest21211-21taskset19:48:053
414299422,32cyclictest21211-21taskset19:48:053
414299413,28cyclictest18370-21chrt22:02:513
414299413,26cyclictest14420-21taskset19:27:523
414299403,28cyclictest3809-21chrt20:33:133
414299402,28cyclictest32457-21chrt20:22:573
414299402,28cyclictest28630-21taskset20:08:593
414299402,28cyclictest28630-21taskset20:08:593
414299393,26cyclictest18457-21taskset19:38:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional