You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 07:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sat Nov 15, 2025 00:44:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258621560,2sleep20-21swapper/219:40:362
258621560,2sleep20-21swapper/219:40:362
258621560,2sleep20-21swapper/219:40:362
62121100,3sleep20-21swapper/223:27:502
62121100,3sleep20-21swapper/223:27:502
62121100,3sleep20-21swapper/223:27:502
2407121030,8chrt12-21ksoftirqd/019:10:440
2407121030,8chrt12-21ksoftirqd/019:10:440
112072990,4sleep30-21swapper/323:04:363
112072990,4sleep30-21swapper/323:04:363
292952940,3chrt0-21swapper/223:59:172
292952940,3chrt0-21swapper/223:59:172
76532930,3sleep20-21swapper/223:35:502
76532930,3sleep20-21swapper/223:35:502
77262880,3sleep20-21swapper/221:50:282
227622870,3sleep30-21swapper/323:51:143
227622870,3sleep30-21swapper/323:51:143
75212860,4sleep30-21swapper/321:50:093
165922820,3sleep30-21swapper/323:45:393
165922820,3sleep30-21swapper/323:45:393
243652810,3sleep20-21swapper/221:32:282
293152780,3sleep20-21swapper/223:24:082
293152780,3sleep20-21swapper/223:24:082
284272780,3sleep10-21swapper/119:20:541
284272780,3sleep10-21swapper/119:20:541
145272770,3sleep30-21swapper/323:07:383
145272770,3sleep30-21swapper/323:07:383
91892750,2sleep30-21swapper/321:50:573
91892750,2sleep30-21swapper/321:50:573
214992740,2chrt0-21swapper/321:30:203
125732740,3sleep10-21swapper/100:15:561
69942690,3sleep10-21swapper/121:14:221
69942690,3sleep10-21swapper/121:14:221
36342640,3sleep30-21swapper/319:40:573
36342640,3sleep30-21swapper/319:40:573
235912640,4chrt0-21swapper/222:42:092
235912640,4chrt0-21swapper/222:42:092
205462640,3chrt0-21swapper/023:14:500
205462640,3chrt0-21swapper/023:14:500
218922630,3sleep1201rcuc/121:30:381
54692620,4sleep20-21swapper/222:57:482
54692620,4sleep20-21swapper/222:57:482
323942620,4sleep30-21swapper/322:16:013
323942620,4sleep30-21swapper/322:16:013
274422610,3chrt27443-21rm22:10:571
315742600,4sleep30-21swapper/321:40:493
315742600,4sleep30-21swapper/321:40:493
2532599602,47cyclictest16761-21ssh23:45:462
2532599602,47cyclictest16761-21ssh23:45:462
144472600,3chrt0-21swapper/321:56:443
144472600,3chrt0-21swapper/321:56:443
2532299584,43cyclictest7531-21ssh23:35:470
2532299584,43cyclictest7531-21ssh23:35:470
135812580,3chrt0-21swapper/300:16:463
2532499578,41cyclictest8126-21ssh21:50:451
2532499578,41cyclictest8126-21ssh21:50:451
95162550,3sleep00-21swapper/023:01:560
95162550,3sleep00-21swapper/023:01:560
105742540,3chrt0-21swapper/021:52:470
105742540,3chrt0-21swapper/021:52:470
250852520,3sleep10-21swapper/123:54:461
250852520,3sleep10-21swapper/123:54:461
196542510,2sleep119664-21sh23:48:281
196542510,2sleep119664-21sh23:48:281
157802510,3sleep20-21swapper/223:44:342
157802510,3sleep20-21swapper/223:44:342
141622510,4chrt0-21swapper/121:56:181
141622510,4chrt0-21swapper/121:56:181
137472510,2sleep113915-21awk21:21:021
137472510,2sleep113915-21awk21:21:021
90562500,3chrt0-21swapper/100:11:541
90562500,3chrt0-21swapper/100:11:541
5152500,4chrt0-21swapper/122:16:561
5152500,4chrt0-21swapper/122:16:561
4842500,4chrt0-21swapper/323:27:393
4842500,4chrt0-21swapper/323:27:393
4842500,4chrt0-21swapper/323:27:393
302422500,1sleep030288-21/usr/sbin/munin19:25:520
236702500,3chrt0-21swapper/321:31:243
308042490,3sleep30-21swapper/322:15:333
2532499498,30cyclictest30496-21ssh00:00:451
2532499498,30cyclictest30496-21ssh00:00:451
25322994931,10cyclictest12-21ksoftirqd/019:20:480
25322994931,10cyclictest12-21ksoftirqd/019:20:480
274382480,2sleep20-21swapper/220:45:582
274382480,2sleep20-21swapper/220:45:582
274382480,2sleep20-21swapper/220:45:582
25322994821,21cyclictest12-21ksoftirqd/020:30:450
25322994821,21cyclictest12-21ksoftirqd/020:30:450
210412480,3chrt0-21swapper/023:50:350
210412480,3chrt0-21swapper/023:50:350
185472480,3chrt0-21swapper/322:00:583
185472480,3chrt0-21swapper/322:00:583
27962470,3sleep30-21swapper/300:05:503
258322460,4sleep30-21swapper/320:40:573
25322994625,12cyclictest12-21ksoftirqd/000:05:460
312262450,3sleep10-21swapper/121:40:431
312262450,3sleep10-21swapper/121:40:431
194912450,3chrt0-21swapper/323:13:123
194912450,3chrt0-21swapper/323:13:123
316852440,3sleep00-21swapper/019:30:500
25324994430,11cyclictest0-21swapper/121:35:471
25324994430,11cyclictest0-21swapper/121:35:471
25324994416,12cyclictest4479-21ssh00:06:541
2532499434,31cyclictest30047-21ssh00:35:451
25324994316,10cyclictest6433-21rm22:23:551
25324994316,10cyclictest6433-21rm22:23:551
25324994315,11cyclictest25809-21ssh22:09:571
25324994315,11cyclictest25809-21ssh22:09:571
25324994315,11cyclictest19359-21ssh00:23:091
25324994315,11cyclictest19359-21ssh00:23:091
2532299434,23cyclictest21356-21ssh23:15:460
2532299434,23cyclictest21356-21ssh23:15:460
25322994312,23cyclictest38850irq/55-eth021:20:500
25322994312,23cyclictest38850irq/55-eth021:20:500
25324994214,10cyclictest16314-21ssh22:35:101
25324994214,10cyclictest16314-21ssh22:35:101
25324994214,10cyclictest15990-21ssh23:44:531
25324994214,10cyclictest15990-21ssh23:44:531
136242420,3sleep30-21swapper/320:10:353
136242420,3sleep30-21swapper/320:10:353
84982410,2sleep10-21swapper/123:00:571
84982410,2sleep10-21swapper/123:00:571
2532599412,26cyclictest7641-21runrttasks23:00:452
2532599412,26cyclictest7641-21runrttasks23:00:452
25324994116,9cyclictest28028-21ssh23:57:171
25324994116,9cyclictest28028-21ssh23:57:171
25324994114,12cyclictest23064-21ssh22:41:221
25324994114,12cyclictest23064-21ssh22:41:221
25324994114,11cyclictest20863-21ssh23:15:191
25324994114,11cyclictest20863-21ssh23:15:191
25324994015,9cyclictest1817-21sh23:29:341
25324994015,9cyclictest1817-21sh23:29:341
25324994015,9cyclictest1817-21sh23:29:341
25324994015,11cyclictest14409-21sh23:07:281
25324994015,11cyclictest14409-21sh23:07:281
25324994015,10cyclictest7613-21ssh21:50:181
25324994015,10cyclictest29293-21ssh23:24:061
25324994015,10cyclictest29293-21ssh23:24:061
25324994014,11cyclictest11828-21taskset22:30:141
25324994014,11cyclictest11828-21taskset22:30:141
25322994021,10cyclictest12-21ksoftirqd/019:50:450
25322994021,10cyclictest12-21ksoftirqd/019:50:450
18742400,9sleep333-21ksoftirqd/321:05:523
18742400,9sleep333-21ksoftirqd/321:05:523
91292390,4chrt0-21swapper/300:12:003
91292390,4chrt0-21swapper/300:12:003
25324993926,9cyclictest22104-21apt-get21:30:491
25324993926,9cyclictest21308-21apt-get20:30:451
25324993926,9cyclictest21308-21apt-get20:30:451
25324993924,10cyclictest21267-21apt-get00:25:471
25324993924,10cyclictest21267-21apt-get00:25:471
25324993915,10cyclictest28736-21ssh00:33:501
25324993914,11cyclictest23056-21sh23:16:381
25324993914,11cyclictest23056-21sh23:16:381
25324993914,11cyclictest21087-21ssh22:40:251
25324993912,8cyclictest13565-21apt-get20:10:371
25324993912,8cyclictest13565-21apt-get20:10:371
25324993912,11cyclictest17454-21sed20:20:351
25324993912,11cyclictest17454-21sed20:20:351
17952390,3sleep30-21swapper/322:54:233
309542380,3chrt0-21swapper/320:55:523
309542380,3chrt0-21swapper/320:55:523
275592380,3chrt0-21swapper/222:10:582
25324993825,10cyclictest28603-21apt-get20:50:461
25324993815,9cyclictest32193-21ssh22:51:121
25324993815,8cyclictest4838-21ssh23:32:031
25324993815,8cyclictest4838-21ssh23:32:031
25324993812,12cyclictest19352-21rm22:02:041
25324993812,12cyclictest19352-21rm22:02:041
2532299382,20cyclictest38850irq/55-eth022:20:440
2532299382,20cyclictest38850irq/55-eth022:20:440
2532599371,33cyclictest16562-21ssh00:20:452
2532599371,33cyclictest16562-21ssh00:20:452
25324993715,7cyclictest28152-21sh22:47:091
25324993715,7cyclictest28152-21sh22:47:091
25324993714,11cyclictest9552-21sh23:37:091
25324993714,11cyclictest9552-21sh23:37:091
25324993712,10cyclictest20627-21awk20:25:581
25324993712,10cyclictest20627-21awk20:25:581
2532299371,23cyclictest16896-21diskmemload22:35:470
182002370,3chrt0-21swapper/320:20:523
182002370,3chrt0-21swapper/320:20:523
25324993629,3cyclictest845-21apt-get19:35:461
25324993629,3cyclictest845-21apt-get19:35:461
25324993629,3cyclictest845-21apt-get19:35:461
25324993628,5cyclictest13931-21apt-get20:10:451
25324993628,5cyclictest13931-21apt-get20:10:451
25324993626,7cyclictest26792-21apt-get20:45:501
25324993626,7cyclictest26792-21apt-get20:45:501
25324993626,7cyclictest26792-21apt-get20:45:501
25324993615,9cyclictest8366-21grep19:55:471
25324993615,9cyclictest8366-21grep19:55:471
25324993614,8cyclictest11451-21ssh21:19:091
25324993614,8cyclictest11451-21ssh21:19:091
2532299363,20cyclictest38850irq/55-eth000:25:480
2532299363,20cyclictest38850irq/55-eth000:25:480
2532299362,27cyclictest0-21swapper/019:15:440
2532299362,27cyclictest0-21swapper/019:15:440
96292350,3sleep20-21swapper/200:12:472
96292350,3sleep20-21swapper/200:12:472
25324993519,12cyclictest0-21swapper/119:30:461
25324993513,8cyclictest10791-21ntpq20:00:541
25324993513,8cyclictest10791-21ntpq20:00:541
2532299352,28cyclictest0-21swapper/020:50:450
2532299352,27cyclictest2914-21date22:55:420
149852350,2sleep014997-21sh00:18:530
71502340,2sleep27163-21ssh21:14:362
71502340,2sleep27163-21ssh21:14:362
2532599342,24cyclictest0-21swapper/223:10:472
2532599342,24cyclictest0-21swapper/223:10:472
25324993418,11cyclictest24997-21apt-get20:40:471
25324993411,13cyclictest2974-21sh22:55:441
25324993411,13cyclictest2974-21sh22:55:441
2532299343,24cyclictest12186-21ssh23:05:470
2532299343,24cyclictest12186-21ssh23:05:470
25322993428,3cyclictest0-21swapper/020:25:460
25322993428,3cyclictest0-21swapper/020:25:460
2532299341,28cyclictest0-21swapper/020:45:500
2532299341,28cyclictest0-21swapper/020:45:500
2532299341,28cyclictest0-21swapper/020:45:500
244452340,3chrt0-21swapper/219:10:502
244452340,3chrt0-21swapper/219:10:502
142372340,3sleep30-21swapper/321:21:243
142372340,3sleep30-21swapper/321:21:243
273922330,4sleep30-21swapper/300:31:253
2532599333,27cyclictest11774-21ssh00:15:462
2532599333,26cyclictest13895-21cat20:10:412
2532599333,26cyclictest13895-21cat20:10:412
319672320,3sleep00-21swapper/022:15:580
319672320,3sleep00-21swapper/022:15:580
307592320,2sleep20-21swapper/222:50:462
273732320,4sleep30-21swapper/323:56:163
273732320,4sleep30-21swapper/323:56:163
2532599323,25cyclictest17376-21ssh21:25:472
2532599323,23cyclictest30721-21latency_hist22:50:422
2532599323,23cyclictest30721-21latency_hist22:50:422
2532599321,23cyclictest0-21swapper/221:40:452
2532599321,23cyclictest0-21swapper/221:40:452
2532299322,26cyclictest0-21swapper/020:35:470
2532299322,26cyclictest0-21swapper/020:35:470
25322993221,7cyclictest121ksoftirqd/020:10:440
25322993221,7cyclictest121ksoftirqd/020:10:440
232692320,2sleep223277-21ssh23:16:582
232692320,2sleep223277-21ssh23:16:582
162582320,2sleep30-21swapper/322:35:063
162582320,2sleep30-21swapper/322:35:063
322742310,3sleep20-21swapper/200:01:462
322742310,3sleep20-21swapper/200:01:462
2532599312,2cyclictest0-21swapper/221:00:462
2532599312,2cyclictest0-21swapper/221:00:462
25324993120,9cyclictest5795-1kworker/u9:019:50:401
25322993124,4cyclictest0-21swapper/021:30:490
25322993115,12cyclictest38850irq/55-eth023:30:470
25322993115,12cyclictest38850irq/55-eth023:30:470
2532599302,23cyclictest8134-21rm21:15:482
2532599302,23cyclictest8134-21rm21:15:482
25324993019,8cyclictest1610-21/usr/sbin/munin21:06:041
25324993019,8cyclictest1610-21/usr/sbin/munin21:06:041
292352290,3sleep00-21swapper/022:13:130
25324992920,6cyclictest0-21swapper/119:50:451
25324992920,6cyclictest0-21swapper/119:50:451
25324992919,8cyclictest952-21users21:01:001
25324992919,8cyclictest952-21users21:01:001
25324992918,9cyclictest25575-21sshd19:14:161
25324992918,9cyclictest25575-21sshd19:14:161
25324992918,9cyclictest24611-21sshd20:39:171
25324992918,9cyclictest24611-21sshd20:39:171
25324992916,10cyclictest30629-21grep20:55:491
25324992916,10cyclictest30629-21grep20:55:491
25324992916,10cyclictest19055-21chrt20:23:151
25324992916,10cyclictest19055-21chrt20:23:151
2532299292,22cyclictest3032-21ssh22:55:480
2532299292,22cyclictest3032-21ssh22:55:480
25322992915,9cyclictest38850irq/55-eth020:10:410
25322992915,9cyclictest38850irq/55-eth020:10:410
149262290,3sleep20-21swapper/223:08:172
149262290,3sleep20-21swapper/223:08:172
108962290,4sleep00-21swapper/000:14:420
108962290,4sleep00-21swapper/000:14:420
2532599285,19cyclictest27-21ksoftirqd/222:00:462
2532599285,19cyclictest27-21ksoftirqd/222:00:462
2532599284,17cyclictest21938-21ssh22:05:452
2532599284,17cyclictest21938-21ssh22:05:452
25324992816,9cyclictest30462-21seq19:25:551
25324992816,9cyclictest0-21swapper/119:40:451
25324992816,9cyclictest0-21swapper/119:40:451
25324992815,9cyclictest0-21swapper/119:15:441
25324992815,9cyclictest0-21swapper/119:15:441
2532299283,19cyclictest29650irq/49-vc410:36:090
2532299282,17cyclictest38850irq/55-eth022:00:450
2532299282,17cyclictest38850irq/55-eth022:00:450
25322992816,10cyclictest12640-21memory23:40:530
25322992816,10cyclictest12640-21memory23:40:530
2532299281,21cyclictest26717-21sh21:35:480
2532299281,21cyclictest26717-21sh21:35:480
2532599272,18cyclictest27-21ksoftirqd/219:25:452
25322992714,10cyclictest38850irq/55-eth022:25:460
25322992714,10cyclictest38850irq/55-eth022:25:460
51612260,3sleep20-21swapper/223:32:322
51612260,3sleep20-21swapper/223:32:322
2532699266,13cyclictest0-21swapper/300:00:453
2532699266,13cyclictest0-21swapper/300:00:453
2532699263,16cyclictest0-21swapper/322:05:473
2532699263,16cyclictest0-21swapper/322:05:473
2532299262,17cyclictest26041-21ssh23:20:470
2532299262,17cyclictest26041-21ssh23:20:470
25322992614,10cyclictest2421-21latency_hist00:05:360
25322992614,10cyclictest2421-21latency_hist00:05:360
295182250,3chrt0-21swapper/321:38:243
295182250,3chrt0-21swapper/321:38:243
2532599252,20cyclictest21290-21rm00:25:482
2532599252,20cyclictest21290-21rm00:25:482
2532599251,18cyclictest19505-21seq20:25:472
2532599251,18cyclictest19505-21seq20:25:472
25322992512,7cyclictest0-21swapper/019:55:450
25322992512,7cyclictest0-21swapper/019:55:450
241862251,17sleep30-21swapper/319:10:483
241862251,17sleep30-21swapper/319:10:483
8042240,3sleep30-21swapper/300:39:253
2532699243,14cyclictest0-21swapper/322:40:493
2532699243,14cyclictest0-21swapper/322:40:493
2532699243,14cyclictest0-21swapper/320:30:463
2532699243,14cyclictest0-21swapper/320:30:463
2532599249,10cyclictest27-21ksoftirqd/220:10:442
2532599249,10cyclictest27-21ksoftirqd/220:10:442
2532599244,14cyclictest27-21ksoftirqd/220:15:452
2532599244,14cyclictest27-21ksoftirqd/220:15:452
2532299243,18cyclictest12392-21ssh22:30:480
2532299243,18cyclictest12392-21ssh22:30:480
25322992410,10cyclictest0-21swapper/019:50:400
2532599232,16cyclictest12693-21sh21:55:462
2532599232,16cyclictest12693-21sh21:55:462
2532599231,9cyclictest118742ssh22:30:182
2532599231,9cyclictest118742ssh22:30:182
2532599231,7cyclictest286472which19:20:582
2532599231,7cyclictest286472which19:20:582
25325992314,6cyclictest27496-21latency_hist19:20:412
25325992314,6cyclictest27496-21latency_hist19:20:412
25322992315,6cyclictest31299-21ntp_states23:25:560
25322992315,6cyclictest31299-21ntp_states23:25:560
25322992315,6cyclictest31299-21ntp_states23:25:560
180552230,4sleep30-21swapper/323:46:003
180552230,4sleep30-21swapper/323:46:003
47312220,2sleep30-21swapper/322:21:163
47312220,2sleep30-21swapper/322:21:163
2532599222,14cyclictest21313-21taskset20:30:462
2532599222,14cyclictest21313-21taskset20:30:462
25325992210,10cyclictest29202-21ssh00:34:402
2532299227,12cyclictest26101-21fschecks_count23:55:480
2532299227,12cyclictest26101-21fschecks_count23:55:480
2532299222,14cyclictest12695-21ssh21:55:460
2532299222,14cyclictest12695-21ssh21:55:460
25322992218,2cyclictest0-21swapper/022:45:470
25322992218,2cyclictest0-21swapper/022:45:470
25322992216,4cyclictest0-21swapper/000:35:470
25322992212,8cyclictest0-21swapper/000:20:450
25322992212,8cyclictest0-21swapper/000:20:450
25322992210,10cyclictest1563-21ps19:35:550
25322992210,10cyclictest1563-21ps19:35:550
25322992210,10cyclictest1563-21ps19:35:550
140362221,3sleep30-21swapper/320:10:483
140362221,3sleep30-21swapper/320:10:483
33972210,2sleep30-21swapper/323:30:523
33972210,2sleep30-21swapper/323:30:523
2532699216,9cyclictest0-21swapper/322:35:473
2532699214,11cyclictest0-21swapper/319:35:453
2532699214,11cyclictest0-21swapper/319:35:453
2532699214,11cyclictest0-21swapper/319:35:453
2532699213,14cyclictest0-21swapper/300:20:453
2532699213,14cyclictest0-21swapper/300:20:453
2532599218,10cyclictest18248-21ntpq20:20:532
2532599218,10cyclictest18248-21ntpq20:20:532
2532599211,4cyclictest131rcu_preempt22:30:582
2532599211,4cyclictest131rcu_preempt22:30:582
25325992114,5cyclictest27853-21unixbench_multi21:35:592
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional