You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-08 - 08:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sat Nov 08, 2025 00:45:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1318421640,5chrt0-21swapper/319:10:563
1318421640,5chrt0-21swapper/319:10:563
3227621560,2sleep00-21swapper/000:24:190
3227621560,2sleep00-21swapper/000:24:190
1710521230,7sleep117089-21ssh00:05:511
1710521230,7sleep117089-21ssh00:05:511
1710521230,7sleep117089-21ssh00:05:511
1819021220,2sleep30-21swapper/322:51:263
1819021220,2sleep30-21swapper/322:51:263
1915121210,2chrt17869-21/usr/sbin/munin23:30:540
1915121210,2chrt17869-21/usr/sbin/munin23:30:540
86321090,3sleep30-21swapper/323:10:313
86321090,3sleep30-21swapper/323:10:313
164921090,4sleep30-21swapper/321:21:243
55282980,3sleep10-21swapper/122:01:041
106262950,3sleep20-21swapper/221:31:072
106262950,3sleep20-21swapper/221:31:072
321002940,3sleep30-21swapper/321:55:443
321002940,3sleep30-21swapper/321:55:443
150652900,3chrt0-21swapper/122:11:371
150652900,3chrt0-21swapper/122:11:371
39472880,3sleep10-21swapper/123:51:041
39472880,3sleep10-21swapper/123:51:041
17132870,3sleep10-21swapper/120:10:411
108602860,2sleep20-21swapper/223:21:192
108602860,2sleep20-21swapper/223:21:192
181032840,3sleep20-21swapper/223:30:432
181032840,3sleep20-21swapper/223:30:432
312252820,3sleep30-21swapper/321:54:513
312252820,3sleep30-21swapper/321:54:513
128492810,4sleep30-21swapper/322:45:513
128492810,4sleep30-21swapper/322:45:513
321092790,4sleep330414-21kworker/3:120:05:413
321092790,4sleep330414-21kworker/3:120:05:413
299412790,4sleep30-21swapper/321:17:023
299412790,4sleep30-21swapper/321:17:023
247742790,2sleep227-21ksoftirqd/223:38:072
247742790,2sleep227-21ksoftirqd/223:38:072
297052750,3sleep0121ksoftirqd/021:52:270
297052750,3sleep0121ksoftirqd/021:52:270
60122740,2sleep30-21swapper/321:26:063
60122740,2sleep30-21swapper/321:26:063
252802730,3sleep30-21swapper/321:47:323
252802730,3sleep30-21swapper/321:47:323
119682710,2sleep011750-21ls19:10:370
119682710,2sleep011750-21ls19:10:370
38642700,2sleep30-21swapper/320:15:453
38642700,2sleep30-21swapper/320:15:453
87212690,3chrt0-21swapper/323:56:413
87212690,3chrt0-21swapper/323:56:413
307032690,3chrt0-21swapper/323:45:353
164072670,3sleep20-21swapper/220:50:402
164072670,3sleep20-21swapper/220:50:402
175752650,3chrt0-21swapper/221:39:512
175752650,3chrt0-21swapper/221:39:512
13228996533,18cyclictest38850irq/55-eth023:40:370
13228996533,18cyclictest38850irq/55-eth023:40:370
1323099644,41cyclictest13286-21ssh22:10:392
1323099644,41cyclictest13286-21ssh22:10:392
81442610,2sleep30-21swapper/322:05:043
250582610,3sleep30-21swapper/323:38:363
250582610,3sleep30-21swapper/323:38:363
1322999607,41cyclictest22860-21ssh21:45:361
1322999607,41cyclictest22860-21ssh21:45:361
156672590,3sleep30-21swapper/323:27:113
206592580,3sleep20-21swapper/222:55:272
206592580,3sleep20-21swapper/222:55:272
1323099583,45cyclictest30713-21ssh23:45:362
1323099583,45cyclictest30713-21ssh23:45:362
309762570,3sleep30-21swapper/323:45:393
309762570,3sleep30-21swapper/323:45:393
296562570,3sleep30-21swapper/323:44:113
295072570,3sleep20-21swapper/221:52:092
295072570,3sleep20-21swapper/221:52:092
290362560,2sleep029082-21ntpq19:55:460
290362560,2sleep029082-21ntpq19:55:460
247952560,3sleep20-21swapper/221:46:472
247952560,3sleep20-21swapper/221:46:472
231062550,3sleep30-21swapper/322:20:483
1323099551,48cyclictest15897-21ssh00:05:382
1323099551,48cyclictest15897-21ssh00:05:382
1323099551,48cyclictest15897-21ssh00:05:382
1322899559,10cyclictest131rcu_preempt21:20:390
161372540,3sleep30-21swapper/300:05:413
161372540,3sleep30-21swapper/300:05:413
161372540,3sleep30-21swapper/300:05:413
146452540,7sleep333-21ksoftirqd/319:15:503
146452540,7sleep333-21ksoftirqd/319:15:503
14052540,4sleep30-21swapper/300:25:463
14052540,4sleep30-21swapper/300:25:463
294502520,3chrt13227-21cyclictest23:05:402
294502520,3chrt13227-21cyclictest23:05:402
291702520,7sleep333-21ksoftirqd/319:55:483
291702520,7sleep333-21ksoftirqd/319:55:483
202142520,3sleep30-21swapper/323:32:453
202142520,3sleep30-21swapper/323:32:453
161042520,2sleep223165-21diskmemload22:50:132
161042520,2sleep223165-21diskmemload22:50:132
1322999521,44cyclictest809-21ssh00:25:411
1322999521,44cyclictest809-21ssh00:25:411
31482510,3sleep30-21swapper/323:50:463
31482510,3sleep30-21swapper/323:50:463
13230995120,25cyclictest27-21ksoftirqd/219:30:382
13230995120,25cyclictest27-21ksoftirqd/219:30:382
44952500,2sleep20-21swapper/220:15:522
44952500,2sleep20-21swapper/220:15:522
1322899502,40cyclictest6945-21ssh23:55:400
1322899502,40cyclictest6945-21ssh23:55:400
116442490,2sleep30-21swapper/321:32:453
116442490,2sleep30-21swapper/321:32:453
200442480,2sleep120054-21ssh22:54:301
200442480,2sleep120054-21ssh22:54:301
161632480,2sleep016169-21sh23:28:010
13228994833,10cyclictest38850irq/55-eth023:20:390
13228994833,10cyclictest38850irq/55-eth023:20:390
13228994816,23cyclictest38850irq/55-eth022:40:400
13228994816,23cyclictest38850irq/55-eth022:40:400
1323099474,37cyclictest20936-21ssh22:55:382
1323099474,37cyclictest20936-21ssh22:55:382
1322999473,32cyclictest23545-21ssh21:10:401
1322999471,41cyclictest26464-21ssh23:40:381
1322999471,41cyclictest26464-21ssh23:40:381
322042460,2sleep032342-21fschecks_time20:05:430
322042460,2sleep032342-21fschecks_time20:05:430
1322999465,34cyclictest7703-21ssh22:40:391
1322999465,34cyclictest7703-21ssh22:40:391
92622450,4chrt0-21swapper/123:57:311
92622450,4chrt0-21swapper/123:57:311
253552440,4sleep225436-21needreboot00:15:462
253552440,4sleep225436-21needreboot00:15:462
1322999449,7cyclictest131rcu_preempt21:35:401
1322999449,7cyclictest131rcu_preempt21:35:401
13229994421,11cyclictest21-21ksoftirqd/120:20:381
13229994421,11cyclictest21-21ksoftirqd/120:20:381
216552430,3sleep10-21swapper/122:19:491
216552430,3sleep10-21swapper/122:19:491
1322999431,32cyclictest22424-21ssh22:20:401
116012430,3chrt0-21swapper/200:38:472
116012430,3chrt0-21swapper/200:38:472
13230994217,20cyclictest27-21ksoftirqd/220:30:402
13230994217,20cyclictest27-21ksoftirqd/220:30:402
1322899421,34cyclictest16575-21ssh22:50:400
1322899421,34cyclictest16575-21ssh22:50:400
110472410,2sleep30-21swapper/300:37:443
110472410,2sleep30-21swapper/300:37:443
15862400,2sleep00-21swapper/020:10:410
156052400,3sleep00-21swapper/020:46:530
156052400,3sleep00-21swapper/020:46:530
156052400,3sleep00-21swapper/020:46:530
1323099405,24cyclictest5114-21ssh23:15:392
13229994014,18cyclictest21-21ksoftirqd/121:30:401
13229994014,18cyclictest21-21ksoftirqd/121:30:401
38952390,10sleep227-21ksoftirqd/222:35:422
38952390,10sleep227-21ksoftirqd/222:35:422
1322899393,26cyclictest38850irq/55-eth021:30:380
1322899393,26cyclictest38850irq/55-eth021:30:380
13228993921,8cyclictest12-21ksoftirqd/019:20:390
13228993921,8cyclictest12-21ksoftirqd/019:20:390
115422390,3sleep10-21swapper/120:35:531
115422390,3sleep10-21swapper/120:35:531
305542380,2sleep130565-21ssh00:21:151
305542380,2sleep130565-21ssh00:21:151
22562380,2sleep10-21swapper/121:58:071
22562380,2sleep10-21swapper/121:58:071
22232380,3chrt0-21swapper/123:50:241
22232380,3chrt0-21swapper/123:50:241
1323099380,27cyclictest0-21swapper/219:15:412
1323099380,27cyclictest0-21swapper/219:15:412
1322999381,30cyclictest32448-21ssh21:20:391
1322999381,28cyclictest23165-21diskmemload22:05:411
1322999381,28cyclictest23165-21diskmemload22:05:411
1322899383,26cyclictest22413-21ssh22:20:390
1322899382,29cyclictest18326-21ssh21:40:390
1322899382,29cyclictest18326-21ssh21:40:390
1322899375,24cyclictest3543-21sendmail-mta20:20:380
1322899375,24cyclictest3543-21sendmail-mta20:20:380
1322899373,25cyclictest38850irq/55-eth000:25:390
1322899373,25cyclictest38850irq/55-eth000:25:390
1322899371,25cyclictest23165-21diskmemload23:35:380
1322899371,25cyclictest23165-21diskmemload23:35:380
90982360,3sleep30-21swapper/322:41:053
90982360,3sleep30-21swapper/322:41:053
42742360,3chrt0-21swapper/223:14:362
42742360,3chrt0-21swapper/223:14:362
1322899364,22cyclictest4139-21ssh22:00:400
1322899362,30cyclictest29454-21sh23:05:400
1322899362,30cyclictest29454-21sh23:05:400
1322899362,24cyclictest38850irq/55-eth021:10:400
1323199359,18cyclictest0-21swapper/322:55:383
1323199359,18cyclictest0-21swapper/322:55:383
70502340,3chrt0-21swapper/200:32:282
70502340,3chrt0-21swapper/200:32:282
1323199349,20cyclictest0-21swapper/322:10:393
1323199349,20cyclictest0-21swapper/322:10:393
1322999341,28cyclictest27441-21ssh21:50:391
1322999341,28cyclictest27441-21ssh21:50:391
1322999341,27cyclictest0-21swapper/121:40:401
1322999341,27cyclictest0-21swapper/121:40:401
1322899342,24cyclictest38850irq/55-eth021:35:420
1322899342,24cyclictest38850irq/55-eth021:35:420
131932340,1sleep211750-21ls19:11:042
131932340,1sleep211750-21ls19:11:042
1323099333,24cyclictest32459-21ssh21:20:402
1322899332,26cyclictest17520-21taskset19:25:380
1322899332,26cyclictest17520-21taskset19:25:380
227392320,3sleep3321rcuc/321:05:483
13229993215,8cyclictest21-21ksoftirqd/100:10:391
13229993215,8cyclictest21-21ksoftirqd/100:10:391
1322899323,22cyclictest23165-21diskmemload21:45:370
1322899323,22cyclictest23165-21diskmemload21:45:370
119952327,18sleep112092-21df19:10:421
119952327,18sleep112092-21df19:10:421
73502310,4sleep30-21swapper/322:40:253
73502310,4sleep30-21swapper/322:40:253
1322899312,20cyclictest38850irq/55-eth022:30:410
1322899312,20cyclictest38850irq/55-eth022:30:410
126332310,3chrt0-21swapper/000:40:340
126332310,3chrt0-21swapper/000:40:340
1322899303,21cyclictest2582-21ssh23:50:400
1322899303,21cyclictest2582-21ssh23:50:400
13228993023,4cyclictest0-21swapper/019:50:380
13228993023,4cyclictest0-21swapper/019:50:380
1322899301,2cyclictest0-21swapper/021:05:350
321042290,2sleep232105-21cpu20:05:412
321042290,2sleep232105-21cpu20:05:412
255352290,3sleep10-21swapper/100:15:481
255352290,3sleep10-21swapper/100:15:481
1323199299,15cyclictest0-21swapper/323:20:393
1323199299,15cyclictest0-21swapper/323:20:393
1322999292,21cyclictest9374-21taskset23:20:401
1322999292,21cyclictest9374-21taskset23:20:401
1322999292,21cyclictest13658-21ssh23:25:401
13229992919,6cyclictest0-21swapper/121:25:391
13229992919,6cyclictest0-21swapper/121:25:391
1323099285,16cyclictest27975-21sh21:15:382
1323099285,16cyclictest27975-21sh21:15:382
1322999281,21cyclictest29458-21ssh23:05:411
1322999281,21cyclictest29458-21ssh23:05:411
1322899283,15cyclictest29650irq/49-vc410:36:090
1322899283,15cyclictest29650irq/49-vc410:36:090
249942270,3sleep20-21swapper/222:22:522
13229992717,7cyclictest20945-21sh22:55:391
13229992717,7cyclictest20945-21sh22:55:391
1322999271,20cyclictest22123-21ssh23:35:351
1322999271,20cyclictest22123-21ssh23:35:351
1322899277,11cyclictest11457-21ssh00:00:390
1322899277,11cyclictest11457-21ssh00:00:390
1322899271,2cyclictest0-21swapper/019:40:410
1322899271,2cyclictest0-21swapper/019:40:410
319742260,4sleep227-21ksoftirqd/220:05:322
319742260,4sleep227-21ksoftirqd/220:05:322
240702260,4sleep30-21swapper/321:10:473
1323099261,22cyclictest7859-21cut22:40:432
1323099261,22cyclictest7859-21cut22:40:432
1322899263,18cyclictest8757-21runrttasks22:05:400
1322899263,18cyclictest8757-21runrttasks22:05:400
1322899263,17cyclictest38850irq/55-eth023:15:400
13228992616,6cyclictest0-21swapper/021:55:410
13228992616,6cyclictest0-21swapper/021:55:410
1322899261,19cyclictest5005-21ssh00:30:400
1322899261,19cyclictest5005-21ssh00:30:400
1322899261,19cyclictest15909-21ssh00:05:390
1322899261,19cyclictest15909-21ssh00:05:390
1322899261,19cyclictest15909-21ssh00:05:390
1322899261,17cyclictest732-21runrttasks00:10:390
1322899261,17cyclictest732-21runrttasks00:10:390
216682250,3sleep20-21swapper/222:19:502
216682250,3sleep20-21swapper/222:19:502
20092250,3sleep30-21swapper/323:10:513
20092250,3sleep30-21swapper/323:10:513
1323099252,17cyclictest29091-21rm00:20:402
1323099252,17cyclictest29091-21rm00:20:402
1323099251,18cyclictest9108-21ssh21:30:362
1323099251,18cyclictest9108-21ssh21:30:362
1322999252,17cyclictest12146-21ssh22:45:431
1322999252,17cyclictest12146-21ssh22:45:431
1322899252,17cyclictest135-21systemd-journal22:55:380
1322899252,17cyclictest135-21systemd-journal22:55:380
13228992514,9cyclictest26931-21/usr/sbin/munin22:25:500
13228992514,9cyclictest26931-21/usr/sbin/munin22:25:500
162552240,10sleep333-21ksoftirqd/321:37:473
162552240,10sleep333-21ksoftirqd/321:37:473
144232240,3sleep30-21swapper/300:03:363
144232240,3sleep30-21swapper/300:03:363
1322999242,18cyclictest5132-21ssh23:15:411
1322999241,18cyclictest23165-21diskmemload22:25:391
1322999241,18cyclictest23165-21diskmemload22:25:391
13228992417,5cyclictest16890-21ssh22:14:280
13228992417,5cyclictest16890-21ssh22:14:280
149252230,5sleep114926-21unixbench_multi19:15:521
149252230,5sleep114926-21unixbench_multi19:15:521
1323199234,15cyclictest0-21swapper/320:25:353
1323199234,15cyclictest0-21swapper/320:25:353
1323199231,18cyclictest8757-21taskset22:05:403
1323199231,18cyclictest8757-21taskset22:05:403
1323099232,17cyclictest26974-21diskmemload22:25:402
1323099232,17cyclictest26974-21diskmemload22:25:402
1323099231,9cyclictest26235-21sh21:13:122
1322999234,13cyclictest0-21swapper/120:25:381
1322999234,13cyclictest0-21swapper/120:25:381
13229992316,5cyclictest31199-21find20:00:511
13229992316,5cyclictest31199-21find20:00:511
1322899232,17cyclictest17849-21sh22:15:380
1322899232,17cyclictest17849-21sh22:15:380
13228992317,4cyclictest12558-21ssh22:45:470
13228992317,4cyclictest12558-21ssh22:45:470
13231992214,5cyclictest0-21swapper/322:35:363
13231992214,5cyclictest0-21swapper/322:35:363
1323099225,3cyclictest131rcu_preempt20:55:382
1323099225,3cyclictest131rcu_preempt20:55:382
1323099222,17cyclictest15712-21apt-get19:20:392
1323099222,17cyclictest15712-21apt-get19:20:392
13230992215,5cyclictest2754-21ssh22:34:512
13230992215,5cyclictest2754-21ssh22:34:512
1323099221,18cyclictest21751-21fschecks_count21:05:392
1323099221,16cyclictest5353-21cut20:20:412
1323099221,16cyclictest5353-21cut20:20:412
13230992211,6cyclictest27-21ksoftirqd/219:50:402
13230992211,6cyclictest27-21ksoftirqd/219:50:402
1322999222,17cyclictest31468-21ssh22:30:411
1322999222,17cyclictest31468-21ssh22:30:411
1322999222,15cyclictest26678-21apt-get19:50:351
1322999221,19cyclictest28307-21ls19:55:291
1322999221,19cyclictest28307-21ls19:55:291
1322999221,17cyclictest1196-21cut23:10:411
1322999221,17cyclictest1196-21cut23:10:411
1322999221,14cyclictest30177-21ls20:00:311
1322999221,14cyclictest30177-21ls20:00:311
13228992215,5cyclictest732-21runrttasks21:30:360
13228992215,5cyclictest732-21runrttasks21:30:360
13228992215,5cyclictest27879-21ssh23:03:190
13228992215,5cyclictest27879-21ssh23:03:190
1322899221,11cyclictest28987-21latency_hist00:20:340
1322899221,11cyclictest28987-21latency_hist00:20:340
1323199212,14cyclictest0-21swapper/322:15:383
1323199212,14cyclictest0-21swapper/322:15:383
1323099211,14cyclictest26771-21ls23:40:422
1323099211,14cyclictest26771-21ls23:40:422
1322999212,17cyclictest8863-21taskset00:35:381
1322999212,17cyclictest8863-21taskset00:35:381
1322999212,16cyclictest27994-21ssh21:15:401
1322999212,16cyclictest27994-21ssh21:15:401
13229992113,6cyclictest16339-21ntp_states19:20:481
13229992113,6cyclictest16339-21ntp_states19:20:481
1322999211,15cyclictest19587-21cut19:30:411
1322999211,15cyclictest19587-21cut19:30:411
13228992114,5cyclictest3973-21gzip22:35:430
13228992114,5cyclictest3973-21gzip22:35:430
1323199203,13cyclictest0-21swapper/300:15:413
1323199203,13cyclictest0-21swapper/300:15:413
1323099209,8cyclictest1459-21ntpq00:25:472
1323099209,8cyclictest1459-21ntpq00:25:472
13230992013,5cyclictest4748-21sh23:52:242
13230992013,5cyclictest4748-21sh23:52:242
1323099201,17cyclictest8737-21latency_hist20:30:302
1323099201,17cyclictest8737-21latency_hist20:30:302
1322999201,6cyclictest732-21runrttasks19:25:381
1322999201,6cyclictest732-21runrttasks19:25:381
13229992013,5cyclictest27652-21ssh23:02:551
13229992013,5cyclictest27652-21ssh23:02:551
1322999201,17cyclictest12760-21cut20:40:421
1322999201,17cyclictest12760-21cut20:40:421
1322899209,9cyclictest0-21swapper/019:50:340
1322899209,9cyclictest0-21swapper/019:50:340
13228992013,5cyclictest2868-21ssh23:12:090
13228992013,5cyclictest2868-21ssh23:12:090
1322899201,11cyclictest32033-21sh23:45:540
1322899201,11cyclictest32033-21sh23:45:540
1322899201,10cyclictest17707-21cron20:55:260
1322899201,10cyclictest17707-21cron20:55:260
199042190,3sleep1201rcuc/121:00:401
199042190,3sleep1201rcuc/121:00:401
1323199194,12cyclictest0-21swapper/300:30:403
1323199194,12cyclictest0-21swapper/300:30:403
1323199192,11cyclictest0-21swapper/321:00:403
1323199192,11cyclictest0-21swapper/321:00:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional