You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 03:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Aug 16, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20955217710,112sleep020976-21unixbench_singl19:05:460
1999421459,34sleep220013-21apt-get19:05:062
214809912254,61cyclictest6325-40ogrotate23:59:550
214809912254,61cyclictest6325-40ogrotate23:59:550
214809911616,69cyclictest14394-21seq21:38:320
214809911616,69cyclictest14394-21seq21:38:320
214809911430,53cyclictest15936-21kworker/u17:2+xprtiod00:33:050
21480991142,53cyclictest30371-21ssh22:55:120
214809911212,23cyclictest1995-21sh23:51:480
214809911211,65cyclictest0-21swapper/021:15:000
214809911211,65cyclictest0-21swapper/021:15:000
21480991099,64cyclictest0-21swapper/000:05:120
214809910926,46cyclictest0-21swapper/000:00:400
21480991072,28cyclictest30980-21rm23:46:020
21485991063,71cyclictest20931-21apt-get22:40:111
21480991068,9cyclictest0-21swapper/021:18:160
21480991064,23cyclictest22547-21timerandwakeup21:50:320
21480991063,30cyclictest353-21runrttasks00:11:460
21480991062,24cyclictest29468-21ssh22:53:320
21480991062,23cyclictest4089-21ssh21:21:270
21480991062,23cyclictest4089-21ssh21:21:270
21480991062,23cyclictest353-21runrttasks00:21:480
21480991062,23cyclictest353-21runrttasks00:21:480
21480991059,23cyclictest24685-21ssh00:28:030
21480991059,23cyclictest24685-21ssh00:28:030
21480991053,29cyclictest31250-21ssh22:05:120
214809910531,43cyclictest30888-21kworker/u17:4+xprtiod22:11:470
214809910531,43cyclictest30888-21kworker/u17:4+xprtiod22:11:470
21480991052,24cyclictest29717-21ssh22:02:040
21498991042,76cyclictest6996-21chrt00:00:163
214949910456,35cyclictest26311-21kworker/u19:3+flush-179:000:00:132
21480991044,30cyclictest20661-21gpgv22:40:010
214809910412,22cyclictest29880-21sh00:36:410
21485991033,73cyclictest6945-21apt-get00:00:171
21480991034,27cyclictest353-21runrttasks22:33:000
21480991033,27cyclictest378-21sshd20:24:410
21480991033,26cyclictest14167-21sh23:20:240
21480991032,28cyclictest5563-21munin-run19:59:580
21480991032,25cyclictest30166-21taskset19:35:110
21480991024,28cyclictest26727-21latency_hist19:24:590
21480991013,9cyclictest0-21swapper/022:40:500
21480991012,22cyclictest16819-21ssh21:41:340
214809910038,39cyclictest1278-21kworker/u17:1+nfsiod23:31:520
21480991003,30cyclictest7578-21grep20:05:170
21480991003,30cyclictest7578-21grep20:05:170
21480991003,23cyclictest3134-21grep19:50:290
21480991002,36cyclictest14076-21modprobe22:29:560
21480991002,36cyclictest14076-21modprobe22:29:560
21480991002,23cyclictest10970-21ssh21:32:540
2148099993,8cyclictest0-21swapper/023:45:100
2148099993,10cyclictest0-21swapper/021:25:090
2148099993,10cyclictest0-21swapper/021:25:090
2148099992,27cyclictest5841-21runrttasks22:15:310
2148099984,34cyclictest17160-21/usr/sbin/munin23:25:140
2148099984,32cyclictest10601-21/usr/sbin/munin20:15:180
2148099983,27cyclictest25542-21/usr/sbin/munin21:55:290
2148099983,27cyclictest25542-21/usr/sbin/munin21:55:290
21485999711,69cyclictest1394-21ssh23:00:251
2148099973,24cyclictest9103-21sh23:11:450
2148099963,33cyclictest377-21snmpd23:05:490
2148099963,33cyclictest377-21snmpd23:05:490
2148099963,31cyclictest11257-21sh23:15:260
2148099963,29cyclictest6641-21timerwakeupswit20:00:340
2148099963,29cyclictest6641-21timerwakeupswit20:00:340
2148099962,33cyclictest21921-21tune2fs19:10:190
2149499953,69cyclictest29377-21ssh00:35:502
2148099955,27cyclictest31774-21/usr/sbin/munin19:40:290
21480999543,46cyclictest1-21systemd20:14:570
21480999543,46cyclictest1-21systemd20:14:570
2148099953,32cyclictest24670-21unixbench_multi20:55:310
2148099953,32cyclictest24670-21unixbench_multi20:55:310
2148099953,13cyclictest0-21swapper/021:48:530
2148099952,28cyclictest28390-21ssh21:09:560
2148099944,83cyclictest1364-21apt-get23:00:210
2148099944,31cyclictest353-21runrttasks20:52:430
2148099943,29cyclictest16998-21cmp20:34:590
2148099943,29cyclictest16998-21cmp20:34:590
2148099943,27cyclictest353-21runrttasks00:15:210
2148099942,28cyclictest24598-21fschecks_time22:45:500
2148099942,27cyclictest378-21sshd20:40:440
210442945,63sleep10-21swapper/119:06:081
2148099935,29cyclictest29083-21ntpq19:30:270
2148099935,29cyclictest29083-21ntpq19:30:270
2148099934,24cyclictest353-21runrttasks20:45:300
2148099933,32cyclictest9176-21unixbench_multi22:20:330
2148099933,30cyclictest28295-21modprobe19:29:570
2148099933,30cyclictest25954-21awk21:00:280
2148099933,24cyclictest26291-21awk23:39:560
2148099923,31cyclictest23929-21sort19:15:210
2148099923,30cyclictest13871-21taskset20:25:110
2148099923,28cyclictest926-21/usr/sbin/munin19:45:210
21494999151,12cyclictest181rcu_preempt00:09:442
21494999146,16cyclictest181rcu_preempt20:15:292
2148099914,26cyclictest353-21runrttasks20:35:110
21494998954,12cyclictest181rcu_preempt22:33:142
2149499894,71cyclictest20961-21ssh22:40:122
21494998943,19cyclictest181rcu_preempt20:10:282
21494998943,19cyclictest181rcu_preempt20:10:282
2148599883,60cyclictest29096-21apt-get00:35:121
2148599873,57cyclictest17317-21apt-get20:35:111
21494998665,8cyclictest181rcu_preempt23:55:222
21494998665,8cyclictest181rcu_preempt23:55:222
21494998653,12cyclictest181rcu_preempt22:52:472
21494998643,7cyclictest181rcu_preempt20:40:202
21485998669,8cyclictest0-21swapper/122:02:271
112052860,8sleep1291rcuc/122:25:001
112052860,8sleep1291rcuc/122:25:001
21494998562,18cyclictest21471-21cyclictest21:43:132
21494998548,17cyclictest181rcu_preempt20:30:232
21494998548,17cyclictest181rcu_preempt20:30:232
21494998537,17cyclictest181rcu_preempt22:48:192
2149499853,44cyclictest14060-21apt-get23:20:152
21494998532,18cyclictest0-21swapper/223:10:222
21485998553,23cyclictest24764-21latency22:45:551
21494998458,8cyclictest181rcu_preempt23:39:102
21494998449,13cyclictest181rcu_preempt22:20:142
21494998437,20cyclictest181rcu_preempt23:44:412
21494998436,17cyclictest181rcu_preempt22:08:122
21494998363,13cyclictest32159-21ssh22:57:252
21494998349,10cyclictest181rcu_preempt21:36:342
21494998349,10cyclictest181rcu_preempt21:36:342
21494998345,8cyclictest181rcu_preempt19:15:032
21494998341,16cyclictest0-21swapper/220:54:592
2149499833,71cyclictest1258-21apt-get23:00:112
21494998244,10cyclictest0-21swapper/200:22:292
21494998244,10cyclictest0-21swapper/200:22:292
21494998240,13cyclictest181rcu_preempt23:25:082
21494998240,13cyclictest181rcu_preempt22:10:142
21494998240,13cyclictest181rcu_preempt22:10:142
21494998238,13cyclictest181rcu_preempt23:05:492
21494998238,13cyclictest181rcu_preempt23:05:492
2149499822,35cyclictest15208-21idleruntime-cro20:29:562
2148599822,53cyclictest31-21ksoftirqd/122:18:241
244212810,3sleep30-21swapper/323:35:333
21494998162,12cyclictest21471-21cyclictest23:32:492
21494998145,13cyclictest181rcu_preempt19:55:242
21494998143,17cyclictest181rcu_preempt19:20:222
21494998141,9cyclictest181rcu_preempt19:40:242
21494998136,18cyclictest181rcu_preempt22:26:132
21494998136,18cyclictest181rcu_preempt22:26:132
21485998167,9cyclictest16855-21latency_hist23:24:561
21494998053,21cyclictest13791-21latency_hist20:24:592
21494998052,19cyclictest25652-21switchtime21:55:312
21494998052,19cyclictest25652-21switchtime21:55:312
21494998051,14cyclictest181rcu_preempt21:53:302
21494998048,12cyclictest181rcu_preempt19:25:272
21494998047,11cyclictest181rcu_preempt21:19:582
21494998046,15cyclictest181rcu_preempt00:17:112
21494998042,11cyclictest181rcu_preempt00:10:252
21494998040,10cyclictest181rcu_preempt22:01:092
21494998035,17cyclictest181rcu_preempt23:53:342
21485998058,15cyclictest29391-21proc_pri21:10:301
21485998058,15cyclictest29391-21proc_pri21:10:301
2148599802,48cyclictest31-21ksoftirqd/119:39:171
2148599802,39cyclictest31-21ksoftirqd/123:38:191
21494997941,17cyclictest181rcu_preempt00:32:022
21494997939,14cyclictest181rcu_preempt22:37:392
21494997936,34cyclictest2974-21ls21:20:202
21494997936,34cyclictest2974-21ls21:20:202
21494997935,10cyclictest181rcu_preempt21:31:122
21494997934,23cyclictest0-21swapper/220:00:322
21494997934,23cyclictest0-21swapper/220:00:322
21494997929,14cyclictest0-21swapper/223:45:482
21494997917,26cyclictest0-21swapper/221:10:432
21494997917,26cyclictest0-21swapper/221:10:432
21485997941,10cyclictest181rcu_preempt21:21:331
21485997941,10cyclictest181rcu_preempt21:21:331
21494997854,18cyclictest10950-21fschecks_time23:15:202
21494997842,12cyclictest181rcu_preempt21:05:152
21494997840,16cyclictest181rcu_preempt21:26:012
21494997840,16cyclictest181rcu_preempt21:26:012
21494997840,14cyclictest181rcu_preempt00:26:162
21494997840,14cyclictest181rcu_preempt00:26:162
21494997835,12cyclictest181rcu_preempt21:48:232
2149499782,23cyclictest23798-21cpu20:55:112
2149499782,23cyclictest23798-21cpu20:55:112
21494997819,22cyclictest0-21swapper/219:12:522
21485997858,14cyclictest15074-21latency_hist21:39:591
21485997858,14cyclictest15074-21latency_hist21:39:591
21485997852,20cyclictest17521-21/usr/sbin/munin22:35:231
21485997841,10cyclictest181rcu_preempt21:51:251
21485997836,10cyclictest181rcu_preempt19:55:101
2148599782,42cyclictest31-21ksoftirqd/121:55:231
2148599782,42cyclictest31-21ksoftirqd/121:55:231
21494997746,10cyclictest181rcu_preempt20:36:082
21494997745,10cyclictest181rcu_preempt19:45:302
21494997739,11cyclictest181rcu_preempt22:17:512
21494997735,12cyclictest0-21swapper/219:35:352
21494997630,26cyclictest0-21swapper/219:50:192
21485997651,16cyclictest353-21runrttasks19:45:221
21485997617,24cyclictest291rcuc/121:05:201
2148599759,33cyclictest31-21ksoftirqd/120:02:531
2148599759,33cyclictest31-21ksoftirqd/120:02:531
21485997559,10cyclictest296-21systemd-logind00:24:581
21485997559,10cyclictest296-21systemd-logind00:24:581
21485997555,15cyclictest296-21systemd-logind20:54:571
21485997548,9cyclictest181rcu_preempt22:12:431
21485997548,9cyclictest181rcu_preempt22:12:431
2148599754,37cyclictest31-21ksoftirqd/121:15:151
21485997538,10cyclictest181rcu_preempt21:45:031
21494997439,11cyclictest181rcu_preempt20:45:252
21485997448,8cyclictest181rcu_preempt23:50:071
21494997337,10cyclictest181rcu_preempt21:04:542
21485997359,9cyclictest4591-21unixbench_singl23:55:331
21485997359,9cyclictest4591-21unixbench_singl23:55:331
21485997353,8cyclictest181rcu_preempt23:43:161
21485997350,13cyclictest0-21swapper/122:30:291
21485997348,17cyclictest0-21swapper/100:30:201
2148599732,26cyclictest31-21ksoftirqd/119:42:081
21494997239,12cyclictest181rcu_preempt19:30:282
21494997239,12cyclictest181rcu_preempt19:30:282
21485997256,10cyclictest20490-21runrttasks23:30:151
21485997255,11cyclictest28372-21diskmemload22:05:301
21485997240,8cyclictest181rcu_preempt23:08:021
21485997240,8cyclictest181rcu_preempt23:08:021
2148599721,41cyclictest31-21ksoftirqd/100:12:041
2148599719,32cyclictest31-21ksoftirqd/100:07:061
21485997153,12cyclictest25417-21latency_hist00:29:581
21485997153,12cyclictest25417-21latency_hist00:29:581
21485997150,8cyclictest181rcu_preempt23:14:331
21485997150,8cyclictest181rcu_preempt19:10:201
21485997148,13cyclictest14841-21unixbench_singl20:25:361
21485997143,18cyclictest15486-21cpu20:30:131
21485997143,18cyclictest15486-21cpu20:30:131
2148599712,38cyclictest31-21ksoftirqd/119:51:281
21498997011,41cyclictest0-21swapper/323:00:253
21494997041,10cyclictest181rcu_preempt20:05:072
21494997041,10cyclictest181rcu_preempt20:05:072
2148599705,39cyclictest31-21ksoftirqd/120:15:491
21485997049,12cyclictest0-21swapper/121:00:291
2148599704,38cyclictest31-21ksoftirqd/120:20:081
21485997030,10cyclictest181rcu_preempt21:33:361
21485996949,8cyclictest181rcu_preempt19:15:081
21485996948,17cyclictest21471-21cyclictest22:50:241
21485996943,18cyclictest7625-21seq21:27:261
21485996943,18cyclictest7625-21seq21:27:261
21485996936,10cyclictest181rcu_preempt21:42:551
2148599693,46cyclictest29064-21ntp_kernel_pll_19:30:271
2148599693,46cyclictest29064-21ntp_kernel_pll_19:30:271
21485996928,20cyclictest0-21swapper/122:59:011
2148599683,45cyclictest26862-21latency_hist19:25:001
21485996828,8cyclictest181rcu_preempt23:17:171
2148599682,26cyclictest31-21ksoftirqd/100:15:191
2148599675,26cyclictest31-21ksoftirqd/123:48:421
2148599673,44cyclictest9384-21kernelversion20:10:221
2148599673,44cyclictest9384-21kernelversion20:10:221
2148599672,45cyclictest353-21runrttasks20:08:181
2148599672,45cyclictest353-21runrttasks20:08:181
21485996640,8cyclictest181rcu_preempt23:26:311
21485996635,8cyclictest181rcu_preempt22:21:091
2148599662,24cyclictest31-21ksoftirqd/120:55:151
2148599662,24cyclictest31-21ksoftirqd/120:55:151
2148599661,24cyclictest31-21ksoftirqd/120:45:301
2148599654,40cyclictest20297-21ls20:44:561
21485996539,9cyclictest181rcu_preempt19:25:161
2149899633,45cyclictest19420-21taskset21:45:323
21498996316,35cyclictest0-21swapper/300:35:383
2149899629,38cyclictest0-21swapper/323:21:083
2149899613,41cyclictest7325-21chrt21:26:403
2149899613,41cyclictest7325-21chrt21:26:403
2149899612,44cyclictest10081-21chrt23:14:173
2133226112,29sleep30-21swapper/319:09:573
21498995947,8cyclictest451rcuc/321:44:583
2149899587,33cyclictest0-21swapper/322:40:313
2149899554,37cyclictest23001-21taskset23:34:393
2149899553,40cyclictest2170-21taskset19:48:353
2149899552,42cyclictest17457-21taskset20:35:283
2149899533,36cyclictest22740-21chrt20:50:273
2149899533,35cyclictest17161-21chrt00:15:313
2149899523,37cyclictest11421-21chrt20:15:323
2149899523,36cyclictest32327-21chrt21:15:223
2149899522,34cyclictest27955-21taskset22:00:033
2149899514,34cyclictest13981-21taskset23:20:013
2149899513,37cyclictest26749-21chrt21:57:403
2149899513,37cyclictest26749-21chrt21:57:403
2149899513,35cyclictest24839-21taskset22:45:573
2149899513,35cyclictest17136-21chrt23:25:033
2149899512,40cyclictest25661-21taskset21:00:193
2149899504,28cyclictest28501-21chrt19:30:003
21498995034,10cyclictest451rcuc/300:12:153
2149899503,32cyclictest32565-21taskset22:06:193
2149899503,32cyclictest11125-21chrt21:33:173
2149899502,39cyclictest9108-21taskset22:20:333
2149899502,39cyclictest4795-21taskset21:23:163
2149899502,39cyclictest4795-21taskset21:23:163
2149899502,34cyclictest6984-21chrt23:09:233
2149899502,34cyclictest6984-21chrt23:09:233
2149899502,34cyclictest32692-21chrt23:49:593
2149899502,33cyclictest13600-21taskset22:28:433
2149899502,33cyclictest13600-21taskset22:28:433
2149899493,36cyclictest757-21chrt19:44:593
2149899493,35cyclictest7829-21taskset22:19:563
2149899493,33cyclictest11423-21taskset00:06:123
2149899492,37cyclictest4147-21taskset22:13:403
2149899492,37cyclictest4147-21taskset22:13:403
2149899492,36cyclictest27110-21chrt21:05:133
2149899492,35cyclictest15825-21chrt22:31:233
2149899492,33cyclictest28676-21chrt23:43:023
2149899492,29cyclictest7318-21chrt20:04:593
2149899492,29cyclictest7318-21chrt20:04:593
2149899483,37cyclictest14388-21taskset20:25:283
2149899483,35cyclictest29219-21chrt22:52:543
2149899483,34cyclictest18927-21chrt20:40:023
2149899483,31cyclictest28165-21chrt00:33:593
21498994831,10cyclictest451rcuc/319:31:593
21498994831,10cyclictest451rcuc/319:31:593
2149899482,34cyclictest23734-21chrt21:53:023
2149899482,33cyclictest31661-21taskset22:56:063
2149899482,32cyclictest18658-21chrt22:35:363
2149899463,34cyclictest430-21chrt23:50:113
21498994632,8cyclictest451rcuc/319:21:583
2149899463,27cyclictest22495-21taskset00:24:593
2149899463,27cyclictest22495-21taskset00:24:593
21498994632,10cyclictest451rcuc/319:39:573
2149899454,31cyclictest29882-21taskset21:10:443
2149899454,31cyclictest29882-21taskset21:10:443
21498994533,8cyclictest451rcuc/320:55:303
21498994533,8cyclictest451rcuc/320:55:303
2149899452,32cyclictest4144-21chrt23:55:263
2149899452,32cyclictest4144-21chrt23:55:263
2149899452,28cyclictest17146-21taskset20:35:003
2149899452,28cyclictest17146-21taskset20:35:003
2149899443,31cyclictest24293-21chrt00:27:023
2149899443,31cyclictest24293-21chrt00:27:023
2149899433,26cyclictest25274-21taskset19:20:003
2149899423,30cyclictest3987-21taskset19:54:593
2149899423,30cyclictest13400-21taskset21:36:003
2149899423,30cyclictest13400-21taskset21:36:003
2149899423,29cyclictest20828-21chrt20:45:203
21498994230,8cyclictest451rcuc/320:12:213
21498994230,8cyclictest451rcuc/320:12:213
2149899413,28cyclictest7980-21taskset20:05:283
2149899413,28cyclictest7980-21taskset20:05:283
21498994127,9cyclictest451rcuc/319:11:433
2149899403,27cyclictest5281-21taskset19:57:183
2149899402,28cyclictest13533-21taskset20:24:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional