You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 14:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Tue Aug 04, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8098212810,84sleep08155-21tune2fs18:51:060
93309912348,29cyclictest9321-21cyclictest22:14:370
93359911546,37cyclictest16488-21diskmemload21:34:471
787721137,23sleep10-21swapper/118:50:551
93359911046,35cyclictest352-21runrttasks00:06:521
8184210112,61sleep28220-21irqstats18:51:082
9330999956,34cyclictest20478-21cpu21:01:550
9330999956,34cyclictest20478-21cpu21:01:550
284192980,8sleep30-21swapper/323:55:593
9339999574,14cyclictest1-21systemd23:40:562
9339999571,18cyclictest8886-21sh21:36:022
9339999564,23cyclictest9321-21cyclictest21:50:412
9335998947,37cyclictest0-21swapper/122:45:381
9335998942,41cyclictest0-21swapper/122:46:171
9330998954,11cyclictest181rcu_preempt19:50:540
9339998861,19cyclictest14730-21apt-key19:10:412
9330998867,15cyclictest11729-21unixbench_multi00:21:140
9330998867,15cyclictest11729-21unixbench_multi00:21:140
933099883,69cyclictest26106-21ssh21:10:540
933099883,69cyclictest26106-21ssh21:10:540
9330998743,28cyclictest181rcu_preempt22:15:510
9339998669,10cyclictest17157-21sh20:56:022
9339998667,12cyclictest0-21swapper/219:26:152
933599864,73cyclictest22203-21ssh23:45:541
9335998642,37cyclictest19446-21fschecks_time23:41:011
9330998632,25cyclictest181rcu_preempt23:40:570
933999859,59cyclictest15080-21modprobe19:11:072
933599854,58cyclictest20377-21ssh21:01:451
933599854,58cyclictest20377-21ssh21:01:451
9335998545,33cyclictest16488-21diskmemload23:35:391
9335998545,33cyclictest16488-21diskmemload23:35:391
9330998571,10cyclictest16982-21kworker/u18:0-rpciod23:36:260
9335998451,23cyclictest17949-21fschecks_count21:51:031
9335998442,35cyclictest0-21swapper/122:26:041
933599843,70cyclictest0-21swapper/119:05:561
9330998460,16cyclictest16488-21diskmemload00:09:040
9330998435,13cyclictest181rcu_preempt20:21:110
9330998358,18cyclictest16488-21diskmemload22:25:420
9330998358,18cyclictest16488-21diskmemload22:25:420
9330998348,29cyclictest352-21runrttasks22:01:030
9330998346,30cyclictest0-21swapper/023:35:380
9330998346,30cyclictest0-21swapper/023:35:380
9339998224,36cyclictest21545-21apt-get22:50:532
9335998245,28cyclictest8364-21kworker/u18:1+nfsiod22:12:331
933599823,68cyclictest0-21swapper/120:10:511
933599823,67cyclictest0-21swapper/123:00:511
9330998262,14cyclictest11402-21latency_hist21:40:410
9339998156,17cyclictest1-21systemd23:47:562
933599814,67cyclictest0-21swapper/120:25:541
933599814,67cyclictest0-21swapper/120:25:541
933099816,45cyclictest21282-21grep21:56:080
933099816,45cyclictest21282-21grep21:56:080
9330998157,16cyclictest836-21systemd-run23:10:390
933099814,55cyclictest21964-21ssh22:51:520
9330998144,33cyclictest9321-21cyclictest19:28:280
9330998138,9cyclictest181rcu_preempt23:46:110
9339998065,9cyclictest170-21jbd2/mmcblk2p2-823:09:122
9339998055,15cyclictest15849-21kworker/u17:4-rpciod00:19:512
933599804,64cyclictest0-21swapper/119:15:491
9335997939,32cyclictest0-21swapper/122:20:541
9335997939,32cyclictest0-21swapper/122:20:541
933599793,69cyclictest0-21swapper/119:25:561
933599793,65cyclictest0-21swapper/119:35:531
933599792,72cyclictest0-21swapper/120:20:541
9335997919,53cyclictest22688-21wc22:52:101
933099794,40cyclictest16375-21sshd21:47:570
9339997857,15cyclictest15886-21threads20:51:142
9339997857,15cyclictest15886-21threads20:51:142
9335997863,8cyclictest0-21swapper/123:16:011
9335997856,15cyclictest9321-21cyclictest23:30:191
9335997854,18cyclictest17355-21latency_hist21:50:411
933599783,65cyclictest0-21swapper/123:55:501
9335997836,35cyclictest0-21swapper/122:05:411
9335997832,39cyclictest0-21swapper/100:11:071
9335997832,39cyclictest0-21swapper/100:11:071
933599782,6cyclictest0-21swapper/123:50:511
9330997854,17cyclictest28433-21fschecks_time23:55:590
9330997852,20cyclictest544-21cron22:45:380
832827812,39sleep30-21swapper/318:51:143
9339997763,9cyclictest9321-21cyclictest23:16:032
9335997756,15cyclictest300-21rs:main1
9335997752,17cyclictest5353-21latency_hist20:20:421
933599774,63cyclictest0-21swapper/121:10:521
933599774,63cyclictest0-21swapper/121:10:521
933599773,60cyclictest7915-21ls23:21:141
933599773,60cyclictest7915-21ls23:21:141
9335997734,35cyclictest0-21swapper/122:05:541
9335997734,35cyclictest0-21swapper/122:05:541
933599772,32cyclictest11736-21cpuspeed21:40:561
9330997758,13cyclictest9586-21rm23:25:050
9330997758,13cyclictest9586-21rm23:25:050
933099775,55cyclictest30335-21latency_hist23:05:410
9330997733,14cyclictest181rcu_preempt21:16:080
9330997726,8cyclictest0-21swapper/019:31:100
933099772,46cyclictest18421-21cpuspeed22:45:570
9339997661,10cyclictest9321-21cyclictest22:48:022
9339997654,12cyclictest15849-21kworker/u17:4-writeback00:22:132
9339997654,12cyclictest15849-21kworker/u17:4-writeback00:22:132
9339997652,15cyclictest30566-21threads19:56:122
9339997639,13cyclictest181rcu_preempt22:26:012
9335997646,20cyclictest0-21swapper/100:21:141
9335997646,20cyclictest0-21swapper/100:21:141
933599763,62cyclictest0-21swapper/120:30:511
933599763,62cyclictest0-21swapper/120:30:511
9335997634,35cyclictest0-21swapper/118:56:141
9335997633,38cyclictest0-21swapper/120:06:081
9335997633,38cyclictest0-21swapper/119:45:591
9335997633,38cyclictest0-21swapper/119:45:591
9335997631,34cyclictest0-21swapper/119:55:421
933099763,37cyclictest8505-21latency_hist21:35:420
9330997633,12cyclictest181rcu_preempt19:41:080
9339997560,9cyclictest20191-21kworker/u17:4-rpciod21:05:562
9339997560,10cyclictest16183-21grep23:35:542
9339997556,13cyclictest277-21dbus-daemon22:40:392
9339997556,13cyclictest277-21dbus-daemon22:40:392
9339997548,21cyclictest2927-21fschecks_time21:26:022
9335997552,16cyclictest9321-21cyclictest20:01:141
933599754,58cyclictest19810-21latency_hist19:25:421
933599754,55cyclictest1116-21apt-get23:10:501
9335997543,25cyclictest11714-21latency_hist20:40:401
9335997543,25cyclictest11714-21latency_hist20:40:401
9335997535,33cyclictest0-21swapper/100:20:381
9335997532,37cyclictest0-21swapper/121:36:141
9335997531,36cyclictest0-21swapper/121:16:041
933599752,68cyclictest0-21swapper/120:55:531
933599752,67cyclictest0-21swapper/122:35:561
933599752,67cyclictest0-21swapper/122:35:561
9335997524,29cyclictest181rcu_preempt21:26:021
9330997558,13cyclictest9321-21cyclictest21:21:160
9330997558,13cyclictest9321-21cyclictest21:21:160
9330997552,10cyclictest181rcu_preempt00:15:580
9330997551,15cyclictest300-21rs:main0
9330997547,21cyclictest26413-21apt-key19:45:430
9330997547,21cyclictest26413-21apt-key19:45:430
933099754,39cyclictest10102-21/usr/sbin/munin23:26:100
9339997452,12cyclictest0-21swapper/221:16:012
933999744,35cyclictest19347-21sh21:52:512
933599743,63cyclictest20708-21ssh21:55:541
933599743,63cyclictest20708-21ssh21:55:541
933599743,61cyclictest32702-21apt-get22:15:511
933599742,31cyclictest27184-21sh23:00:331
933599742,31cyclictest11173-21munin-node19:00:451
933599742,31cyclictest11173-21munin-node19:00:451
9330997456,12cyclictest14730-21apt-key19:10:410
9330997455,13cyclictest17549-21unixbench_multi19:16:140
9330997445,22cyclictest19676-21snmpd21:07:320
933099744,33cyclictest12771-21latency22:36:070
933099744,33cyclictest12771-21latency22:36:070
9330997440,11cyclictest7399-21munin-plugin-st00:15:380
9330997440,11cyclictest7399-21munin-plugin-st00:15:380
9335997356,13cyclictest22733-21kworker/u19:3+events_unbound19:45:391
933599733,56cyclictest0-21swapper/120:45:421
9335997332,34cyclictest0-21swapper/121:21:161
9335997332,34cyclictest0-21swapper/121:21:161
9330997352,8cyclictest181rcu_preempt20:55:510
9330997352,15cyclictest9321-21cyclictest22:55:560
9330997344,11cyclictest181rcu_preempt19:55:490
9330997341,10cyclictest181rcu_preempt18:56:060
9330997329,14cyclictest181rcu_preempt21:26:150
9330997327,13cyclictest0-21swapper/019:35:530
203302732,9sleep00-21swapper/021:55:360
9339997256,9cyclictest0-21swapper/223:21:012
9339997256,9cyclictest0-21swapper/223:21:012
9339997253,14cyclictest23380-21fschecks_time19:36:012
933599724,57cyclictest0-21swapper/120:50:541
933599724,57cyclictest0-21swapper/120:50:541
9335997243,19cyclictest14864-21latency_hist20:50:411
933599723,64cyclictest0-21swapper/119:11:211
933599722,6cyclictest0-21swapper/122:30:571
9330997253,12cyclictest0-21swapper/021:41:000
9330997249,16cyclictest300-21rs:main0
933099723,36cyclictest4445-21fschecks_time23:16:020
933099722,58cyclictest3784-21cron23:15:380
9339997149,15cyclictest9321-21cyclictest20:31:012
9339997149,15cyclictest9321-21cyclictest20:31:012
9339997148,17cyclictest28433-21fschecks_time23:56:002
933999714,47cyclictest18120-21latency_hist19:20:412
933999713,46cyclictest415-21wc20:05:412
933999712,31cyclictest26677-21/usr/sbin/munin22:06:032
933999712,31cyclictest26677-21/usr/sbin/munin22:06:032
9335997147,16cyclictest9321-21cyclictest21:08:291
933599712,58cyclictest30581-21apt-get23:05:501
933099714,26cyclictest12068-21fschecks_count20:41:000
9330997136,16cyclictest181rcu_preempt23:51:070
933999705,59cyclictest8373-21kworker/u17:2+ext4-rsv-conversion21:01:132
933999705,59cyclictest8373-21kworker/u17:2+ext4-rsv-conversion21:01:132
9339997037,18cyclictest39-21ksoftirqd/223:01:272
933999703,34cyclictest16488-21diskmemload21:56:042
933999703,34cyclictest16488-21diskmemload21:56:042
9339997032,14cyclictest181rcu_preempt20:25:422
933999702,47cyclictest18495-21fschecks_time19:21:012
933999702,45cyclictest3751-21latency_hist20:15:422
9335997053,11cyclictest18924-21ssh23:40:401
933599702,58cyclictest29811-21apt-get19:55:491
9335997011,50cyclictest0-21swapper/100:05:411
9330997033,12cyclictest181rcu_preempt20:11:160
9330997019,7cyclictest181rcu_preempt22:35:410
9339996952,11cyclictest25347-21ssh22:56:142
9339996951,12cyclictest2374-21systemd-journal00:09:562
9339996946,16cyclictest1365-21sh21:23:052
9339996946,16cyclictest1365-21sh21:23:052
933999693,31cyclictest13108-21wc19:05:422
933999693,31cyclictest13108-21wc19:05:422
933999693,26cyclictest12070-21rm21:41:042
9339996931,22cyclictest39-21ksoftirqd/200:04:522
933999692,42cyclictest17975-21latency_hist22:45:412
9330996942,10cyclictest181rcu_preempt19:20:540
9330996935,14cyclictest181rcu_preempt00:03:290
933099692,22cyclictest10258-21/usr/sbin/munin20:36:140
933099692,22cyclictest10258-21/usr/sbin/munin20:36:140
9339996845,16cyclictest9321-21cyclictest19:51:142
933999683,56cyclictest26708-21cpu19:46:492
933999683,56cyclictest26708-21cpu19:46:492
933999683,32cyclictest1451-21fschecks_time23:11:022
933099684,29cyclictest6258-21/usr/sbin/munin22:25:490
9330996837,25cyclictest0-21swapper/020:31:050
9330996837,25cyclictest0-21swapper/020:31:050
933099683,53cyclictest11530-21grep19:00:510
933099683,53cyclictest11530-21grep19:00:510
9330996811,48cyclictest15051-21apt-get19:11:080
9339996752,11cyclictest9321-21cyclictest21:31:102
9339996751,12cyclictest9321-21cyclictest23:26:262
9339996745,15cyclictest0-21swapper/220:40:412
9339996745,15cyclictest0-21swapper/220:40:412
933999673,42cyclictest5591-21timerandwakeup00:11:142
933999673,42cyclictest5591-21timerandwakeup00:11:142
933999673,27cyclictest39-21ksoftirqd/222:16:342
9339996648,12cyclictest26367-21latency_hist22:05:402
933999662,46cyclictest12184-21latency_hist22:35:422
933099663,45cyclictest13769-21fschecks_time20:45:590
9330996632,8cyclictest181rcu_preempt22:06:060
9330996632,8cyclictest181rcu_preempt22:06:060
9339996547,11cyclictest0-21swapper/222:15:172
9339996547,11cyclictest0-21swapper/220:41:152
933999653,45cyclictest25949-21mailstats23:51:132
9339996526,7cyclictest181rcu_preempt21:11:302
9339996526,7cyclictest181rcu_preempt21:11:302
9339996518,33cyclictest25624-21grep19:41:152
933099653,44cyclictest7327-21fschecks_time20:26:010
933099653,44cyclictest7327-21fschecks_time20:26:010
9330996534,26cyclictest0-21swapper/020:55:410
9330996534,26cyclictest0-21swapper/020:55:410
9339996449,9cyclictest298-21in:imuxsock20:30:382
9339996449,9cyclictest298-21in:imuxsock20:30:382
9339996448,10cyclictest0-21swapper/223:31:062
9339996448,10cyclictest0-21swapper/223:31:062
933999644,42cyclictest352-21runrttasks20:49:522
9339996416,13cyclictest381ktimers/222:22:222
9339996416,13cyclictest381ktimers/222:22:222
933999633,41cyclictest23059-21latency_hist19:35:422
933999625,36cyclictest39-21ksoftirqd/220:16:432
933999623,37cyclictest9777-21fschecks_time18:56:012
9330996234,9cyclictest181rcu_preempt20:05:510
933999612,41cyclictest352-21runrttasks20:09:082
9349996013,27cyclictest0-21swapper/322:50:563
934999582,42cyclictest5480-21chrt21:30:413
934999574,34cyclictest0-21swapper/321:01:443
934999574,34cyclictest0-21swapper/321:01:443
934999563,37cyclictest13636-21taskset00:25:423
934999563,37cyclictest13636-21taskset00:25:423
934999562,40cyclictest28129-21taskset19:50:413
934999562,40cyclictest28129-21taskset19:50:413
934999544,36cyclictest22857-21chrt19:35:393
934999543,40cyclictest28545-21chrt23:01:153
934999543,36cyclictest25936-21chrt22:04:293
934999542,37cyclictest23757-21chrt19:36:113
934999542,35cyclictest13466-21chrt20:45:423
934999534,36cyclictest18247-21taskset20:57:123
934999534,34cyclictest23757-21chrt21:06:123
934999533,38cyclictest20073-21taskset22:48:063
934999533,38cyclictest10630-21chrt22:31:573
934999533,34cyclictest5154-21chrt20:20:393
9349995326,18cyclictest0-21swapper/321:30:573
934999532,13cyclictest150822sleep319:11:083
934999524,36cyclictest11846-21chrt19:01:043
934999524,36cyclictest11846-21chrt19:01:043
934999523,40cyclictest3829-21taskset00:09:043
934999523,36cyclictest15500-21chrt21:46:143
934999523,35cyclictest30220-21chrt22:11:063
934999523,35cyclictest19905-21chrt21:54:243
934999523,34cyclictest25980-21chrt22:57:103
934999523,34cyclictest13622-21taskset19:06:063
934999523,33cyclictest6257-21taskset22:25:493
934999522,38cyclictest27254-21taskset23:54:013
934999522,38cyclictest10163-21chrt23:25:523
934999515,31cyclictest20640-21chrt19:26:153
934999513,37cyclictest31777-21taskset00:01:103
934999513,35cyclictest3296-21chrt23:14:173
934999513,35cyclictest11150-21taskset21:40:103
934999513,33cyclictest28735-21taskset21:15:373
934999513,33cyclictest28735-21taskset21:15:373
934999513,32cyclictest2167-21taskset20:10:423
934999512,35cyclictest14163-21chrt20:46:103
934999512,33cyclictest444-21taskset22:16:003
934999504,32cyclictest10523-21chrt20:36:023
934999504,32cyclictest10523-21chrt20:36:023
934999503,35cyclictest21864-21chrt23:45:383
934999503,34cyclictest21320-21taskset21:56:113
934999503,34cyclictest21320-21taskset21:56:113
934999503,33cyclictest9509-21taskset18:55:493
934999503,31cyclictest7021-21taskset23:20:423
934999503,30cyclictest2562-21chrt21:25:423
934999503,30cyclictest2562-21chrt21:25:423
934999502,35cyclictest7599-21chrt20:26:103
934999502,35cyclictest7599-21chrt20:26:103
934999502,34cyclictest7295-21taskset23:20:583
934999502,34cyclictest7295-21taskset23:20:583
934999502,34cyclictest4681-21chrt00:10:463
934999502,34cyclictest4681-21chrt00:10:463
934999502,34cyclictest22525-21taskset23:46:033
934999502,28cyclictest32455-21taskset23:08:253
934999493,34cyclictest2833-21chrt20:11:113
934999493,34cyclictest17341-21chrt22:43:563
934999493,33cyclictest3663-21chrt22:21:033
934999493,33cyclictest3663-21chrt22:21:033
934999493,33cyclictest15234-21taskset20:50:563
934999493,33cyclictest15234-21taskset20:50:563
934999493,32cyclictest29403-21chrt21:16:013
934999492,37cyclictest16140-21taskset23:35:493
934999484,30cyclictest6843-21chrt20:25:413
9349994836,8cyclictest451rcuc/320:00:383
934999483,35cyclictest8009-21chrt00:16:013
934999483,35cyclictest14994-21chrt23:33:223
934999483,35cyclictest14994-21chrt23:33:223
934999472,32cyclictest12034-21chrt21:41:033
934999472,31cyclictest18398-21chrt19:20:563
934999464,28cyclictest24980-21chrt19:41:013
934999443,27cyclictest31400-21chrt20:00:503
934999442,30cyclictest13052-21taskset22:36:153
934999442,30cyclictest13052-21taskset22:36:153
934999433,28cyclictest16679-21chrt19:15:543
9349994330,9cyclictest451rcuc/322:06:003
9349994330,9cyclictest451rcuc/322:06:003
9349994028,8cyclictest451rcuc/319:51:133
9349993925,8cyclictest451rcuc/320:33:353
9349993925,8cyclictest451rcuc/320:33:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional