You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 10:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Fri Sep 11, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
402521289,80sleep04079-21fschecks_time19:05:030
52609911855,56cyclictest8975-21apt-key19:19:310
52609911855,56cyclictest8975-21apt-key19:19:310
5260991183,78cyclictest0-21swapper/022:19:420
52609911225,55cyclictest0-21swapper/021:31:390
52609910949,50cyclictest0-21swapper/020:15:500
5260991093,69cyclictest0-21swapper/021:23:320
5260991093,69cyclictest0-21swapper/021:23:320
5260991084,98cyclictest0-21swapper/022:34:430
5274991073,94cyclictest26823-21apt-get00:09:442
5260991072,75cyclictest2816-21sshd00:23:250
5260991072,75cyclictest2816-21sshd00:23:250
5260991042,63cyclictest6061-21grep21:50:010
5260991034,88cyclictest0-21swapper/022:14:380
5260991032,66cyclictest7213-21/usr/sbin/munin00:29:590
5260991025,61cyclictest0-21swapper/023:41:480
5260991008,54cyclictest0-21swapper/022:11:230
5260991004,65cyclictest0-21swapper/021:55:390
5260991003,60cyclictest14595-21sh22:56:580
5260991002,61cyclictest26943-21ssh00:10:000
52609910013,56cyclictest16677-21sh22:07:540
527499999,79cyclictest30002-21apt-get22:29:432
5260999944,49cyclictest7891-21latency_hist23:39:300
526099992,57cyclictest6119-21seq20:48:520
5260999915,59cyclictest29242-21sh22:28:550
526099983,65cyclictest0-21swapper/023:33:090
526099983,65cyclictest0-21swapper/023:33:090
526099983,55cyclictest0-21swapper/022:30:500
5274999775,15cyclictest25792-21fschecks_count23:15:442
526099972,83cyclictest0-21swapper/020:54:410
526099972,64cyclictest343-21runrttasks22:51:480
516129715,41sleep20-21swapper/219:09:292
526099963,64cyclictest15569-21modprobe19:39:280
526099963,64cyclictest15569-21modprobe19:39:280
526099962,62cyclictest11577-21seq00:37:270
526099962,60cyclictest343-21runrttasks23:27:170
526099962,60cyclictest2645-21seq20:35:520
526099962,22cyclictest9052-21ssh22:48:260
526099962,22cyclictest9052-21ssh22:48:260
526099955,84cyclictest0-21swapper/023:59:440
526099953,73cyclictest343-21runrttasks20:10:130
526099953,55cyclictest29607-21seq23:20:370
526099953,55cyclictest20265-21latency_hist23:59:300
526099953,55cyclictest20265-21latency_hist23:59:300
40802958,63sleep14105-21cat19:05:041
526099944,85cyclictest0-21swapper/022:39:430
526099943,62cyclictest18710-21seq19:45:510
526099942,62cyclictest17371-21seq19:44:210
5260999418,50cyclictest0-21swapper/023:51:450
5260999413,56cyclictest24418-21sh21:27:390
5260999413,56cyclictest24418-21sh21:27:390
5274999316,21cyclictest8647-21diskmemload23:40:372
526099932,81cyclictest32581-21ssh21:40:040
526099932,54cyclictest27253-21seq23:17:330
526099923,61cyclictest14076-21modprobe23:49:280
5260999232,50cyclictest0-21swapper/019:49:500
5274999152,14cyclictest11761-21ssh21:59:512
5274999152,14cyclictest11761-21ssh21:59:512
526099915,55cyclictest0-21swapper/023:08:110
526099913,77cyclictest0-21swapper/020:29:390
526099912,57cyclictest23420-21awk20:00:050
526099912,57cyclictest23420-21awk20:00:050
526099903,82cyclictest0-21swapper/021:09:390
526099903,81cyclictest0-21swapper/021:14:420
5260999029,49cyclictest0-21swapper/021:00:000
526099902,7cyclictest0-21swapper/022:59:440
526099902,7cyclictest0-21swapper/022:59:440
526099902,56cyclictest12592-21seq21:05:570
526099902,56cyclictest12592-21seq21:05:570
5274998963,17cyclictest12891-21diskmemload23:44:512
5274998948,9cyclictest181rcu_preempt19:14:522
5274998948,9cyclictest181rcu_preempt19:14:522
5274998944,17cyclictest181rcu_preempt20:50:392
5274998944,17cyclictest181rcu_preempt20:50:392
526099892,60cyclictest30147-21ssh21:36:040
5260998918,48cyclictest0-21swapper/019:25:020
5260998918,48cyclictest0-21swapper/019:25:020
5274998844,13cyclictest181rcu_preempt22:34:582
5268998870,12cyclictest27360-21apt-key20:14:321
526099884,53cyclictest0-21swapper/021:46:390
526099883,59cyclictest24676-21latency_hist23:14:310
526099883,59cyclictest24676-21latency_hist23:14:310
5260998833,48cyclictest0-21swapper/000:05:060
526099882,76cyclictest22402-21latency_hist19:59:310
526099882,60cyclictest30989-21ssh00:15:110
5274998766,15cyclictest28579-21fschecks_time23:19:492
5274998737,13cyclictest181rcu_preempt19:13:482
5274998737,13cyclictest181rcu_preempt19:13:482
5268998772,10cyclictest6072-21unixbench_singl23:35:051
526099873,78cyclictest0-21swapper/000:24:440
526099873,74cyclictest31724-21grep20:25:040
526099872,6cyclictest0-21swapper/020:39:430
526099872,6cyclictest0-21swapper/020:39:430
5260998712,70cyclictest0-21swapper/021:59:460
5260998712,70cyclictest0-21swapper/021:59:460
5274998661,11cyclictest181rcu_preempt20:09:522
5274998651,20cyclictest181rcu_preempt22:55:062
5274998651,12cyclictest181rcu_preempt21:44:532
5268998668,13cyclictest5251-21cyclictest22:59:311
5268998665,14cyclictest15833-21apt-key19:39:321
5268998665,14cyclictest15833-21apt-key19:39:321
526099868,56cyclictest343-21runrttasks20:49:450
526099868,56cyclictest343-21runrttasks20:49:450
526099866,71cyclictest0-21swapper/019:29:300
526099866,71cyclictest0-21swapper/019:29:300
5274998565,12cyclictest0-21swapper/222:49:542
5274998560,10cyclictest181rcu_preempt20:04:532
5274998550,13cyclictest181rcu_preempt22:59:522
5274998550,13cyclictest181rcu_preempt22:59:522
5274998536,8cyclictest181rcu_preempt22:14:042
5268998565,14cyclictest18204-21kworker/u17:0-rpciod23:59:561
5274998460,15cyclictest19759-21ntp_kernel_pll_19:49:562
5274998434,13cyclictest181rcu_preempt00:28:482
528199834,43cyclictest0-21swapper/300:09:543
5274998357,9cyclictest181rcu_preempt23:25:252
5274998355,12cyclictest181rcu_preempt00:04:302
5274998351,13cyclictest181rcu_preempt20:29:522
5274998349,8cyclictest181rcu_preempt20:34:502
5274998346,14cyclictest8330-21ssh00:31:522
5274998340,19cyclictest181rcu_preempt20:59:292
5274998322,15cyclictest0-21swapper/219:24:572
5274998322,15cyclictest0-21swapper/219:24:572
526099834,69cyclictest13921-21apt19:34:280
5274998259,16cyclictest23429-21unixbench_singl21:25:052
5274998259,16cyclictest23429-21unixbench_singl21:25:052
5274998256,10cyclictest181rcu_preempt23:09:302
5274998236,18cyclictest181rcu_preempt23:50:012
526099822,56cyclictest24984-21timerwakeupswit20:05:050
5274998147,12cyclictest181rcu_preempt21:54:412
5274998136,9cyclictest181rcu_preempt23:54:512
5274998136,9cyclictest181rcu_preempt23:54:512
5274998131,7cyclictest181rcu_preempt19:29:542
5274998124,13cyclictest0-21swapper/223:34:452
526899813,60cyclictest25355-21taskset23:14:581
5268998126,25cyclictest29882-21cpu00:14:431
5268998113,33cyclictest0-21swapper/119:39:501
526099813,67cyclictest0-21swapper/020:19:390
5274998058,14cyclictest343-21runrttasks22:40:032
5274998056,17cyclictest29882-21cpu00:14:432
5274998052,12cyclictest181rcu_preempt20:24:472
5274998049,10cyclictest181rcu_preempt22:44:582
5274998049,10cyclictest181rcu_preempt22:44:582
5274998043,13cyclictest181rcu_preempt20:39:582
5274998043,13cyclictest181rcu_preempt20:39:582
5274998042,29cyclictest5111-21tune2fs20:44:512
5274998042,12cyclictest181rcu_preempt20:59:442
5274998039,14cyclictest181rcu_preempt00:22:152
5274998039,14cyclictest181rcu_preempt00:22:152
5274998025,31cyclictest0-21swapper/219:59:512
5274998025,31cyclictest0-21swapper/219:59:512
5268998013,24cyclictest1044-21seq20:30:591
5274997951,8cyclictest181rcu_preempt00:05:112
5274997944,9cyclictest181rcu_preempt22:09:222
5274997942,14cyclictest181rcu_preempt21:10:022
5274997935,10cyclictest0-21swapper/222:22:332
527499793,47cyclictest27572-21apt-get20:14:422
5268997958,14cyclictest200-21systemd-journal23:02:251
5268997958,14cyclictest200-21systemd-journal23:02:251
5268997917,27cyclictest3811-21ssh23:32:111
5268997917,27cyclictest3811-21ssh23:32:111
5268997911,30cyclictest0-21swapper/123:51:191
526099793,62cyclictest0-21swapper/019:09:420
526099793,62cyclictest0-21swapper/019:09:420
5274997846,12cyclictest181rcu_preempt23:12:262
5274997846,12cyclictest181rcu_preempt23:12:262
5274997838,18cyclictest181rcu_preempt19:27:122
5274997838,18cyclictest181rcu_preempt19:27:122
5268997861,10cyclictest21781-21kworker/u17:2-ext4-rsv-conversion00:09:431
5268997811,23cyclictest0-21swapper/123:28:461
5274997749,7cyclictest181rcu_preempt00:35:122
5274997739,13cyclictest181rcu_preempt23:31:562
5274997739,13cyclictest181rcu_preempt23:31:562
5274997738,16cyclictest181rcu_preempt19:59:312
5274997731,16cyclictest181rcu_preempt21:19:472
5274997731,16cyclictest181rcu_preempt21:19:472
5268997763,9cyclictest5251-21cyclictest22:24:311
5268997716,25cyclictest8690-21seq22:47:261
5268997716,25cyclictest8690-21seq22:47:261
5268997716,24cyclictest8859-21seq23:40:421
5268997713,22cyclictest20584-21seq19:54:221
5274997643,8cyclictest181rcu_preempt21:35:082
5274997639,18cyclictest181rcu_preempt21:34:312
5274997637,13cyclictest181rcu_preempt22:24:522
5274997633,11cyclictest181rcu_preempt20:19:412
527499762,39cyclictest39-21ksoftirqd/221:06:362
527499762,39cyclictest39-21ksoftirqd/221:06:362
5268997658,12cyclictest317-21dbus-daemon00:09:291
5268997654,14cyclictest200-21systemd-journal22:42:251
5268997615,30cyclictest1764-21seq00:20:331
5268997615,30cyclictest1764-21seq00:20:331
5268997613,24cyclictest5400-21seq20:45:001
5274997551,10cyclictest181rcu_preempt19:45:542
5274997519,10cyclictest181rcu_preempt21:18:492
5268997555,14cyclictest11424-21latency_hist21:04:311
5268997511,26cyclictest0-21swapper/120:06:111
527499748,41cyclictest359-21snmpd19:39:532
5274997442,16cyclictest181rcu_preempt22:14:492
5274997422,31cyclictest39-21ksoftirqd/221:41:442
5268997454,14cyclictest22926-21sh21:24:571
5268997454,14cyclictest22926-21sh21:24:571
5274997340,12cyclictest181rcu_preempt19:35:022
5274997340,12cyclictest181rcu_preempt19:35:022
526899737,31cyclictest6795-21munin-plugin-st19:14:291
526899737,31cyclictest6795-21munin-plugin-st19:14:291
5268997356,11cyclictest10925-21ssh22:50:141
5268997315,27cyclictest12891-21diskmemload22:27:371
5268997311,22cyclictest0-21swapper/119:59:351
5268997311,22cyclictest0-21swapper/119:59:351
5274997213,29cyclictest39-21ksoftirqd/221:54:212
526899727,26cyclictest0-21swapper/121:08:561
526899727,26cyclictest0-21swapper/121:08:561
526899727,25cyclictest28707-21irqstats23:19:521
5268997256,12cyclictest32112-21kworker/u17:2-rpciod21:10:041
526899724,35cyclictest0-21swapper/120:34:551
5268997214,26cyclictest28704-21seq20:16:451
5268997214,21cyclictest20371-21ssh23:06:021
5268997213,25cyclictest8710-21seq19:18:051
5268997213,25cyclictest8710-21seq19:18:051
5268997213,22cyclictest6633-21seq21:50:281
5268997212,26cyclictest9567-21seq20:58:491
5268997212,24cyclictest28639-21seq21:34:351
5268997157,8cyclictest0-21swapper/123:59:301
5268997157,8cyclictest0-21swapper/123:59:301
526899715,30cyclictest0-21swapper/120:39:501
526899715,30cyclictest0-21swapper/120:39:501
5268997151,14cyclictest11202-21sh21:59:291
526899713,32cyclictest12891-21diskmemload00:34:301
5268997116,20cyclictest0-21swapper/122:09:191
5268997114,23cyclictest11399-21ssh00:36:581
5268997113,24cyclictest30353-21seq20:22:001
5268997113,23cyclictest1-21systemd22:39:291
5268997112,23cyclictest13127-21seq23:46:581
5268997111,28cyclictest19457-21ssh22:12:121
5268997110,24cyclictest0-21swapper/120:53:371
5268997110,24cyclictest0-21swapper/120:53:371
5281997014,30cyclictest0-21swapper/323:39:443
5268997012,29cyclictest10653-21seq19:24:001
5268997012,29cyclictest10653-21seq19:24:001
5268997012,23cyclictest13692-21seq19:31:461
526899697,28cyclictest0-21swapper/121:14:501
526899697,26cyclictest0-21swapper/119:44:541
526899696,26cyclictest0-21swapper/119:25:421
526899696,26cyclictest0-21swapper/119:25:421
5268996956,7cyclictest0-21swapper/122:14:481
5268996946,13cyclictest0-21swapper/122:00:061
5268996946,13cyclictest0-21swapper/122:00:061
528199688,35cyclictest0-21swapper/321:29:583
5268996822,8cyclictest0-21swapper/122:30:401
5268996814,23cyclictest21375-21seq21:22:391
5268996814,23cyclictest21375-21seq21:22:391
5268996813,18cyclictest31967-21seq20:27:061
5268996812,19cyclictest32160-21seq21:39:541
5268996713,24cyclictest20882-21seq19:54:421
5268996713,23cyclictest27296-21ssh21:31:351
5268996712,25cyclictest5221-21seq00:26:411
5268996546,13cyclictest2763-21kernelversion21:44:531
526899652,27cyclictest0-21swapper/123:11:201
526899652,27cyclictest0-21swapper/123:11:201
528199619,25cyclictest0-21swapper/323:15:203
528199617,44cyclictest0-21swapper/320:15:263
528199604,42cyclictest26422-21taskset22:24:283
528199603,41cyclictest2952-21taskset00:23:493
528199603,41cyclictest2952-21taskset00:23:493
528199603,33cyclictest901-21kworker/3:1+events22:14:323
528199593,40cyclictest25099-21taskset20:05:063
528199593,35cyclictest901-21kworker/3:1+events19:14:413
528199593,35cyclictest901-21kworker/3:1+events19:14:413
528199584,39cyclictest11194-21taskset19:25:013
528199584,39cyclictest11194-21taskset19:25:013
528199583,35cyclictest901-21kworker/3:1+events19:34:543
528199583,35cyclictest901-21kworker/3:1+events19:34:543
528199582,42cyclictest21292-21chrt21:22:263
528199582,42cyclictest21292-21chrt21:22:263
528199574,41cyclictest10177-21taskset21:56:513
528199573,39cyclictest17882-21chrt19:44:493
528199573,38cyclictest19738-21taskset23:05:043
528199573,37cyclictest1019-21chrt22:34:533
528199572,39cyclictest32583-21chrt00:19:273
528199572,38cyclictest901-21kworker/3:1+events21:53:483
528199563,39cyclictest3516-21chrt21:45:163
528199563,38cyclictest29225-21chrt23:20:033
528199563,38cyclictest24252-21taskset21:27:123
528199563,38cyclictest24252-21taskset21:27:123
528199563,38cyclictest12880-21chrt19:29:513
528199563,37cyclictest8830-21chrt22:47:503
528199563,37cyclictest8830-21chrt22:47:503
517425610,28sleep30-21swapper/319:09:303
528199553,37cyclictest6225-21chrt23:35:273
528199553,37cyclictest3872-21taskset20:40:013
528199553,37cyclictest3872-21taskset20:40:013
528199553,34cyclictest5096-21taskset20:44:503
5281995511,27cyclictest0-21swapper/322:29:493
528199543,40cyclictest18212-21chrt23:55:043
528199543,40cyclictest18212-21chrt23:55:043
528199543,38cyclictest27606-21chrt22:25:043
528199543,37cyclictest12947-21chrt22:54:463
528199543,36cyclictest17094-21chrt23:54:273
528199543,34cyclictest10880-21chrt00:35:323
528199542,39cyclictest20432-21chrt23:59:333
528199542,38cyclictest9146-21taskset00:34:063
528199542,36cyclictest22348-21chrt19:59:313
5281995411,30cyclictest16074-21taskset19:39:513
528199534,33cyclictest2963-21chrt23:30:083
528199534,33cyclictest2963-21chrt23:30:083
528199533,36cyclictest16442-21chrt22:07:173
528199533,33cyclictest9060-21chrt20:55:033
528199533,32cyclictest0-21swapper/319:14:323
528199533,32cyclictest0-21swapper/319:14:323
528199532,36cyclictest19553-21chrt19:49:513
528199532,32cyclictest3760-21taskset00:24:503
528199524,34cyclictest14006-21chrt21:10:013
528199523,33cyclictest22493-21chrt19:59:393
528199523,33cyclictest22493-21chrt19:59:393
528199522,36cyclictest25913-21chrt00:08:333
528199522,36cyclictest17181-21chrt23:00:383
528199522,36cyclictest17181-21chrt23:00:383
528199513,36cyclictest5827-21taskset22:42:553
528199513,36cyclictest29257-21chrt20:19:443
528199513,33cyclictest22256-21chrt23:09:503
528199513,33cyclictest22256-21chrt23:09:503
528199513,32cyclictest29432-21chrt21:35:033
528199512,36cyclictest18832-21chrt21:19:053
528199512,33cyclictest12120-21chrt21:59:593
528199512,33cyclictest12120-21chrt21:59:593
528199512,33cyclictest11878-21chrt23:44:553
528199512,28cyclictest0-21swapper/320:50:013
528199512,28cyclictest0-21swapper/320:50:013
528199502,34cyclictest26601-21chrt20:10:043
528199493,37cyclictest934-21taskset23:27:373
528199493,34cyclictest10920-21chrt22:50:133
528199493,33cyclictest12304-21taskset21:05:033
528199493,33cyclictest12304-21taskset21:05:033
528199493,30cyclictest901-21kworker/3:1+events19:29:313
528199493,30cyclictest901-21kworker/3:1+events19:29:313
528199482,34cyclictest32380-21chrt20:29:323
528199482,32cyclictest2180-21chrt21:44:313
528199473,33cyclictest23145-21chrt22:18:563
528199473,33cyclictest10457-21chrt20:59:573
528199473,28cyclictest3168-21chrt20:39:323
528199383,28cyclictest901-21kworker/3:1+events20:29:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional