You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 06:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Wed Dec 17, 2025 00:45:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2004599247116,22cyclictest0-21swapper/219:06:152
2004599247116,22cyclictest0-21swapper/219:06:152
861299237119,99cyclictest0-21swapper/023:21:300
861299237119,99cyclictest0-21swapper/023:21:300
862599235133,83cyclictest0-21swapper/222:55:222
862599235133,83cyclictest0-21swapper/222:55:222
862599235133,83cyclictest0-21swapper/222:55:222
861299234115,96cyclictest0-21swapper/023:25:220
861299234115,96cyclictest0-21swapper/023:25:220
861299234115,96cyclictest0-21swapper/023:25:220
862599228128,79cyclictest0-21swapper/222:00:202
862599228128,79cyclictest0-21swapper/222:00:202
862599226117,89cyclictest26348-21fschecks_time21:25:482
862599226117,89cyclictest26348-21fschecks_time21:25:482
861299225100,100cyclictest0-21swapper/022:05:060
861299225100,100cyclictest0-21swapper/022:05:060
861299221162,40cyclictest16385-21open_inodes00:16:370
861299221162,40cyclictest16385-21open_inodes00:16:370
861299220109,17cyclictest181rcu_preempt22:56:420
861299220109,17cyclictest181rcu_preempt22:56:420
861299220109,17cyclictest181rcu_preempt22:56:420
861299220106,19cyclictest181rcu_preempt23:37:000
861299220106,19cyclictest181rcu_preempt23:37:000
861299219107,91cyclictest0-21swapper/021:26:440
861299219107,91cyclictest0-21swapper/021:26:440
86129921899,99cyclictest3076-21latency_hist21:54:550
86129921899,99cyclictest3076-21latency_hist21:54:550
86129921899,99cyclictest3076-21latency_hist21:54:550
861299216110,85cyclictest0-21swapper/023:06:030
861299216110,85cyclictest0-21swapper/023:06:030
862599215111,82cyclictest0-21swapper/200:25:002
862599215111,82cyclictest0-21swapper/200:25:002
86129921590,102cyclictest0-21swapper/022:20:160
86129921590,102cyclictest0-21swapper/022:20:160
861299215101,98cyclictest0-21swapper/023:31:510
861299215101,98cyclictest0-21swapper/023:31:510
862299214108,87cyclictest11961-21kernelversion22:21:031
862299214108,87cyclictest11961-21kernelversion22:21:031
862599213146,44cyclictest6905-21processes23:46:332
862599213146,44cyclictest6905-21processes23:46:332
862599213146,44cyclictest6905-21processes23:46:332
862299213106,27cyclictest181rcu_preempt00:14:441
862299213106,27cyclictest181rcu_preempt00:14:441
862299212120,67cyclictest12675-21ls00:05:211
862299212120,67cyclictest12675-21ls00:05:211
862299212120,67cyclictest12675-21ls00:05:211
862599211151,39cyclictest350-21runrttasks20:56:322
862599211151,39cyclictest350-21runrttasks20:56:322
862599211108,80cyclictest29648-21kernelversion21:36:022
862599211108,80cyclictest29648-21kernelversion21:36:022
86129921197,89cyclictest0-21swapper/022:15:540
86129921197,89cyclictest0-21swapper/022:15:540
86129921197,89cyclictest0-21swapper/022:15:540
86129921159,87cyclictest181rcu_preempt22:40:260
86129921159,87cyclictest181rcu_preempt22:40:260
86129921080,43cyclictest0-21swapper/000:10:210
86129921080,43cyclictest0-21swapper/000:10:210
86129921071,116cyclictest0-21swapper/021:50:050
86129921071,116cyclictest0-21swapper/021:50:050
86129921066,126cyclictest0-21swapper/022:34:550
86129921066,126cyclictest0-21swapper/022:34:550
86129921066,126cyclictest0-21swapper/022:34:550
861299209109,85cyclictest8603-21cyclictest21:11:370
861299209109,85cyclictest8603-21cyclictest21:11:370
861299209109,85cyclictest8603-21cyclictest21:11:370
862599208111,75cyclictest0-21swapper/223:31:562
862599208111,75cyclictest0-21swapper/223:31:562
86129920881,43cyclictest6424-21df_inode23:45:340
86129920881,43cyclictest6424-21df_inode23:45:340
86129920881,43cyclictest6424-21df_inode23:45:340
862299206103,83cyclictest30674-21cstates23:20:251
862299206103,83cyclictest30674-21cstates23:20:251
8612992067,52cyclictest350-21runrttasks22:12:410
8612992067,52cyclictest350-21runrttasks22:12:410
862599205101,28cyclictest0-21swapper/221:14:432
862599205101,28cyclictest0-21swapper/221:14:432
862599205101,28cyclictest0-21swapper/221:14:432
862299205106,28cyclictest181rcu_preempt21:06:391
862299205106,28cyclictest181rcu_preempt21:06:391
86129920478,108cyclictest0-21swapper/021:16:100
86129920478,108cyclictest0-21swapper/021:16:100
86229920395,55cyclictest22469-21kworker/u19:3-flush-179:000:31:101
86229920395,55cyclictest22469-21kworker/u19:3-flush-179:000:31:101
861299203114,17cyclictest181rcu_preempt00:31:460
861299203114,17cyclictest181rcu_preempt00:31:460
86229920298,87cyclictest0-21swapper/122:06:541
86229920298,87cyclictest0-21swapper/122:06:541
86229920298,87cyclictest0-21swapper/122:06:541
86229920298,29cyclictest0-21swapper/121:15:271
86229920298,29cyclictest0-21swapper/121:15:271
86129920288,92cyclictest0-21swapper/023:16:450
86129920288,92cyclictest0-21swapper/023:16:450
86129920281,104cyclictest0-21swapper/021:34:570
86129920281,104cyclictest0-21swapper/021:34:570
86259920198,25cyclictest181rcu_preempt22:25:202
86259920198,25cyclictest181rcu_preempt22:25:202
86229920197,83cyclictest30555-21sendmail21:39:451
86229920197,83cyclictest30555-21sendmail21:39:451
86129920184,94cyclictest0-21swapper/021:55:480
86129920184,94cyclictest0-21swapper/021:55:480
86129920184,94cyclictest0-21swapper/021:55:480
86129920179,102cyclictest0-21swapper/020:42:200
86129920179,102cyclictest0-21swapper/020:42:200
86129920179,102cyclictest0-21swapper/020:42:200
8612992015,51cyclictest13516-21getpatches20:46:150
8612992015,51cyclictest13516-21getpatches20:46:150
86259920089,19cyclictest181rcu_preempt00:10:522
86259920089,19cyclictest181rcu_preempt00:10:522
862599200115,24cyclictest181rcu_preempt21:50:512
862599200115,24cyclictest181rcu_preempt21:50:512
862599200115,24cyclictest181rcu_preempt21:50:512
862599200110,70cyclictest0-21swapper/222:21:042
862599200110,70cyclictest0-21swapper/222:21:042
86229920097,84cyclictest27628-21cut23:10:461
86229920097,84cyclictest27628-21cut23:10:461
8612992006,50cyclictest9099-21runrttasks23:54:320
8612992006,50cyclictest9099-21runrttasks23:54:320
862599199112,67cyclictest0-21swapper/221:49:582
862599199112,67cyclictest0-21swapper/221:49:582
86129919977,99cyclictest0-21swapper/022:25:240
86129919977,99cyclictest0-21swapper/022:25:240
86259919887,91cyclictest9416-21ts2lt20:43:392
86259919887,91cyclictest9416-21ts2lt20:43:392
86259919887,91cyclictest9416-21ts2lt20:43:392
862599198141,33cyclictest8603-21cyclictest22:49:582
862599198141,33cyclictest8603-21cyclictest22:49:582
86229919878,35cyclictest0-21swapper/123:10:041
86229919878,35cyclictest0-21swapper/123:10:041
862299198100,76cyclictest21938-21timerandwakeup21:11:441
862299198100,76cyclictest21938-21timerandwakeup21:11:441
862299198100,76cyclictest21938-21timerandwakeup21:11:441
861299198127,18cyclictest181rcu_preempt22:50:240
861299198127,18cyclictest181rcu_preempt22:50:240
861299198127,18cyclictest181rcu_preempt22:50:240
862599197132,45cyclictest6806-21cpu22:05:262
862599197132,45cyclictest6806-21cpu22:05:262
862599197132,45cyclictest6806-21cpu22:05:262
86229919792,87cyclictest31564-21mailstats21:41:371
86229919792,87cyclictest31564-21mailstats21:41:371
86229919792,87cyclictest31564-21mailstats21:41:371
86229919790,36cyclictest0-21swapper/100:01:241
86229919790,36cyclictest0-21swapper/100:01:241
86229919790,36cyclictest0-21swapper/100:01:241
86129919788,46cyclictest15359-21ntpq20:51:290
86129919788,46cyclictest15359-21ntpq20:51:290
86129919769,105cyclictest0-21swapper/021:05:140
86129919769,105cyclictest0-21swapper/021:05:140
862599196102,70cyclictest0-21swapper/200:01:422
862599196102,70cyclictest0-21swapper/200:01:422
862599196102,70cyclictest0-21swapper/200:01:422
86229919698,79cyclictest18915-21unixbench_singl22:41:501
86229919698,79cyclictest18915-21unixbench_singl22:41:501
86229919689,92cyclictest0-21swapper/120:51:341
86229919689,92cyclictest0-21swapper/120:51:341
86129919683,90cyclictest0-21swapper/021:35:470
86129919683,90cyclictest0-21swapper/021:35:470
8612991967,53cyclictest28364-21grep23:11:480
8612991967,53cyclictest28364-21grep23:11:480
862599195108,21cyclictest181rcu_preempt23:22:042
862599195108,21cyclictest181rcu_preempt23:22:042
86229919593,83cyclictest0-21swapper/121:20:471
86229919593,83cyclictest0-21swapper/121:20:471
862299195152,29cyclictest8603-21cyclictest00:25:211
862299195152,29cyclictest8603-21cyclictest00:25:211
862299195124,27cyclictest181rcu_preempt21:02:291
862299195124,27cyclictest181rcu_preempt21:02:291
862299195106,26cyclictest181rcu_preempt23:04:551
862299195106,26cyclictest181rcu_preempt23:04:551
862299195106,26cyclictest181rcu_preempt23:04:551
86259919472,99cyclictest0-21swapper/221:04:542
86259919472,99cyclictest0-21swapper/221:04:542
862599194100,30cyclictest181rcu_preempt00:09:482
862599194100,30cyclictest181rcu_preempt00:09:482
862599194100,30cyclictest181rcu_preempt00:09:482
86229919494,79cyclictest9215-21timerandwakeup22:11:431
86229919494,79cyclictest9215-21timerandwakeup22:11:431
86229919492,83cyclictest10107-21mailstats23:56:361
86229919492,83cyclictest10107-21mailstats23:56:361
86229919492,83cyclictest10107-21mailstats23:56:361
86129919484,88cyclictest0-21swapper/021:24:430
86129919484,88cyclictest0-21swapper/021:24:430
86129919479,93cyclictest0-21swapper/020:56:020
86129919479,93cyclictest0-21swapper/020:56:020
86129919474,97cyclictest0-21swapper/000:08:390
86129919474,97cyclictest0-21swapper/000:08:390
86129919474,97cyclictest0-21swapper/000:08:390
86129919452,122cyclictest18948-21/usr/sbin/munin00:26:110
86129919452,122cyclictest18948-21/usr/sbin/munin00:26:110
86129919449,18cyclictest0-21swapper/022:45:210
86129919449,18cyclictest0-21swapper/022:45:210
86229919395,78cyclictest6547-21fschecks_time23:45:491
86229919395,78cyclictest6547-21fschecks_time23:45:491
86229919395,78cyclictest6547-21fschecks_time23:45:491
86229919378,29cyclictest364-21snmpd22:34:551
86229919378,29cyclictest364-21snmpd22:34:551
86229919378,29cyclictest364-21snmpd22:34:551
86229919371,51cyclictest0-21swapper/123:31:581
86229919371,51cyclictest0-21swapper/123:31:581
862299193100,29cyclictest181rcu_preempt22:50:221
862299193100,29cyclictest181rcu_preempt22:50:221
862299193100,29cyclictest181rcu_preempt22:50:221
862599192139,33cyclictest0-21swapper/223:41:172
862599192139,33cyclictest0-21swapper/223:41:172
86229919296,77cyclictest9960-21cpu22:15:201
86229919296,77cyclictest9960-21cpu22:15:201
86229919296,77cyclictest9960-21cpu22:15:201
86229919292,28cyclictest181rcu_preempt21:30:471
86229919292,28cyclictest181rcu_preempt21:30:471
86129919273,103cyclictest0-21swapper/021:04:520
86129919273,103cyclictest0-21swapper/021:04:520
86259919196,72cyclictest0-21swapper/221:41:392
86259919196,72cyclictest0-21swapper/221:41:392
86259919196,72cyclictest0-21swapper/221:41:392
86259919189,41cyclictest25906-21apt-get21:25:042
86259919189,41cyclictest25906-21apt-get21:25:042
86229919191,80cyclictest22825-21fschecks_count22:55:451
86229919191,80cyclictest22825-21fschecks_count22:55:451
86229919191,80cyclictest22825-21fschecks_count22:55:451
86229919166,36cyclictest32140-21apt-get21:46:091
86229919166,36cyclictest32140-21apt-get21:46:091
862299191105,70cyclictest0-21swapper/122:01:021
862299191105,70cyclictest0-21swapper/122:01:021
86259919086,20cyclictest181rcu_preempt21:19:522
86259919086,20cyclictest181rcu_preempt21:19:522
862599190151,25cyclictest14098-21timerandwakeup20:47:102
862599190151,25cyclictest14098-21timerandwakeup20:47:102
86229919087,34cyclictest0-21swapper/122:46:361
86229919087,34cyclictest0-21swapper/122:46:361
86229919041,128cyclictest9120-21grep20:43:271
86229919041,128cyclictest9120-21grep20:43:271
86229919041,128cyclictest9120-21grep20:43:271
861299190126,33cyclictest181rcu_preempt23:59:570
861299190126,33cyclictest181rcu_preempt23:59:570
861299190126,33cyclictest181rcu_preempt23:59:570
862599189141,31cyclictest4162-21switchtime21:56:422
862599189141,31cyclictest4162-21switchtime21:56:422
862599189141,31cyclictest4162-21switchtime21:56:422
86229918989,81cyclictest32248-21cstates23:25:261
86229918989,81cyclictest32248-21cstates23:25:261
86229918989,81cyclictest32248-21cstates23:25:261
86229918980,89cyclictest350-21runrttasks23:36:071
86229918980,89cyclictest350-21runrttasks23:36:071
862299189100,71cyclictest0-21swapper/100:16:511
862299189100,71cyclictest0-21swapper/100:16:511
86129918964,102cyclictest0-21swapper/022:39:540
86129918964,102cyclictest0-21swapper/022:39:540
86129918952,115cyclictest0-21swapper/023:45:020
86129918952,115cyclictest0-21swapper/023:45:020
862599188101,17cyclictest181rcu_preempt23:16:162
862599188101,17cyclictest181rcu_preempt23:16:162
86229918884,39cyclictest364-21snmpd23:17:541
86229918884,39cyclictest364-21snmpd23:17:541
86129918872,94cyclictest0-21swapper/021:41:020
86129918872,94cyclictest0-21swapper/021:41:020
86129918872,94cyclictest0-21swapper/021:41:020
86129918862,105cyclictest12324-21latency_hist00:04:570
86129918862,105cyclictest12324-21latency_hist00:04:570
86129918862,105cyclictest12324-21latency_hist00:04:570
86259918736,72cyclictest39-21ksoftirqd/223:54:322
86259918736,72cyclictest39-21ksoftirqd/223:54:322
862599187107,17cyclictest181rcu_preempt23:12:042
862599187107,17cyclictest181rcu_preempt23:12:042
86229918793,79cyclictest5970-21latency_hist23:44:591
86229918793,79cyclictest5970-21latency_hist23:44:591
86229918789,29cyclictest181rcu_preempt23:54:481
86229918789,29cyclictest181rcu_preempt23:54:481
86259918690,76cyclictest21561-21netstat22:51:102
86259918690,76cyclictest21561-21netstat22:51:102
86259918690,76cyclictest21561-21netstat22:51:102
862599186101,34cyclictest31905-21/usr/sbin/munin23:26:572
862599186101,34cyclictest31905-21/usr/sbin/munin23:26:572
862599186101,34cyclictest31905-21/usr/sbin/munin23:26:572
86229918691,75cyclictest0-21swapper/100:36:391
86229918691,75cyclictest0-21swapper/100:36:391
86229918691,73cyclictest0-21swapper/100:21:221
86229918691,73cyclictest0-21swapper/100:21:221
86129918678,96cyclictest0-21swapper/022:06:110
86129918678,96cyclictest0-21swapper/022:06:110
86129918678,96cyclictest0-21swapper/022:06:110
86259918599,40cyclictest29081-21apt-get21:35:052
862599185113,42cyclictest0-21swapper/222:11:242
862599185113,42cyclictest0-21swapper/222:11:242
86229918595,75cyclictest8603-21cyclictest21:55:241
86229918595,75cyclictest8603-21cyclictest21:55:241
86229918595,75cyclictest8603-21cyclictest21:55:241
8612991859,49cyclictest22098-21/usr/sbin/munin00:35:460
8612991859,49cyclictest22098-21/usr/sbin/munin00:35:460
86259918472,91cyclictest18387-21seq22:41:092
86259918472,91cyclictest18387-21seq22:41:092
86229918485,24cyclictest12898-21/usr/sbin/munin22:25:231
86229918485,24cyclictest12898-21/usr/sbin/munin22:25:231
86129918461,73cyclictest15-21ksoftirqd/023:02:530
86129918461,73cyclictest15-21ksoftirqd/023:02:530
86129918461,73cyclictest15-21ksoftirqd/023:02:530
86259918391,25cyclictest8603-21cyclictest22:38:232
86259918391,25cyclictest8603-21cyclictest22:38:232
86259918362,99cyclictest0-21swapper/223:35:192
86259918362,99cyclictest0-21swapper/223:35:192
86229918385,34cyclictest0-21swapper/120:55:241
86229918385,34cyclictest0-21swapper/120:55:241
86129918384,88cyclictest8603-21cyclictest00:20:210
86129918384,88cyclictest8603-21cyclictest00:20:210
2004199183142,25cyclictest8488-21systemd-run19:09:491
2004199183142,25cyclictest8488-21systemd-run19:09:491
86259918179,81cyclictest0-21swapper/200:25:202
86259918179,81cyclictest0-21swapper/200:25:202
86259918174,84cyclictest0-21swapper/223:04:432
86259918174,84cyclictest0-21swapper/223:04:432
86259918174,84cyclictest0-21swapper/223:04:432
862599181132,31cyclictest10380-21unixbench_multi23:56:482
862599181132,31cyclictest10380-21unixbench_multi23:56:482
862599181132,31cyclictest10380-21unixbench_multi23:56:482
86259918086,71cyclictest0-21swapper/200:15:302
86259918086,71cyclictest0-21swapper/200:15:302
86259918057,102cyclictest19652-21cat21:05:242
86259918057,102cyclictest19652-21cat21:05:242
862599179125,25cyclictest0-21swapper/221:30:512
862599179120,34cyclictest0-21swapper/200:31:162
862599179120,34cyclictest0-21swapper/200:31:162
862599179109,17cyclictest181rcu_preempt00:39:582
862599179109,17cyclictest181rcu_preempt00:39:582
86229917988,38cyclictest0-21swapper/121:25:241
86229917988,38cyclictest0-21swapper/121:25:241
86259917883,72cyclictest0-21swapper/220:51:382
86259917883,72cyclictest0-21swapper/220:51:382
86259917831,58cyclictest10963-21unixbench_singl22:16:482
86259917831,58cyclictest10963-21unixbench_singl22:16:482
86259917831,58cyclictest10963-21unixbench_singl22:16:482
862299178129,31cyclictest12405-21cpuspeed20:45:341
862299178129,31cyclictest12405-21cpuspeed20:45:341
200379917898,18cyclictest181rcu_preempt19:06:350
200379917898,18cyclictest181rcu_preempt19:06:350
86259917795,25cyclictest350-21runrttasks22:34:312
86259917795,25cyclictest350-21runrttasks22:34:312
86259917795,25cyclictest350-21runrttasks22:34:312
86229917688,43cyclictest2167-21irqstats21:51:001
86229917688,43cyclictest2167-21irqstats21:51:001
86229917688,43cyclictest2167-21irqstats21:51:001
86259917584,37cyclictest8603-21cyclictest23:09:042
86259917584,37cyclictest8603-21cyclictest23:09:042
86229917587,72cyclictest0-21swapper/122:36:381
86229917587,72cyclictest0-21swapper/122:36:381
86339916587,54cyclictest32141-21chrt21:44:433
86339916587,54cyclictest32141-21chrt21:44:433
86339916587,54cyclictest32141-21chrt21:44:433
8633991566,54cyclictest22867-21chrt21:15:083
8633991566,54cyclictest22867-21chrt21:15:083
8633991566,54cyclictest22867-21chrt21:15:083
8633991527,57cyclictest4876-21chrt22:00:023
8633991527,57cyclictest4876-21chrt22:00:023
8633991527,57cyclictest4876-21chrt22:00:023
8633991496,57cyclictest23106-21chrt21:15:493
8633991496,57cyclictest23106-21chrt21:15:493
8633991467,55cyclictest10732-21chrt23:59:443
8633991467,55cyclictest10732-21chrt23:59:443
8633991467,55cyclictest10732-21chrt23:59:443
8633991457,56cyclictest27208-21chrt23:09:573
8633991457,56cyclictest27208-21chrt23:09:573
8633991456,53cyclictest31196-21taskset23:21:303
8633991456,53cyclictest31196-21taskset23:21:303
8633991447,57cyclictest30147-21taskset21:36:463
8633991447,57cyclictest30147-21taskset21:36:463
86339914445,23cyclictest13343-21chrt20:46:093
86339914445,23cyclictest13343-21chrt20:46:093
8633991437,59cyclictest20503-21chrt21:06:473
8633991437,59cyclictest20503-21chrt21:06:473
8633991437,56cyclictest20478-21chrt00:29:433
8633991437,56cyclictest20478-21chrt00:29:433
8633991437,56cyclictest16272-21chrt22:35:053
8633991437,56cyclictest16272-21chrt22:35:053
86339914310,62cyclictest8926-21chrt20:43:203
86339914310,62cyclictest8926-21chrt20:43:203
86339914310,62cyclictest8926-21chrt20:43:203
8633991427,58cyclictest13905-21chrt00:09:433
8633991427,58cyclictest13905-21chrt00:09:433
8633991427,58cyclictest13905-21chrt00:09:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional