You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 06:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Thu Nov 20, 2025 00:44:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1980321080,2sleep00-21swapper/000:31:060
1980321080,2sleep00-21swapper/000:31:060
2651821000,3sleep10-21swapper/121:39:021
2651821000,3sleep10-21swapper/121:39:021
91772930,2sleep1201rcuc/121:55:541
91772930,2sleep1201rcuc/121:55:541
158792840,2chrt15881-21sshd21:26:201
158792840,2chrt15881-21sshd21:26:201
107772800,3sleep30-21swapper/321:20:593
107772800,3sleep30-21swapper/321:20:593
32552760,3sleep00-21swapper/022:25:430
67472730,4sleep10-21swapper/121:16:271
67472730,4sleep10-21swapper/121:16:271
110792720,3chrt11065-21ssh21:21:011
110792720,3chrt11065-21ssh21:21:011
43432700,3sleep14340-21ssh22:26:001
43432700,3sleep14340-21ssh22:26:001
309012700,3sleep00-21swapper/019:11:090
309012700,3sleep00-21swapper/019:11:090
276552700,2sleep1201rcuc/122:51:321
276552700,2sleep1201rcuc/122:51:321
113622650,7sleep333-21ksoftirqd/323:45:553
113622650,7sleep333-21ksoftirqd/323:45:553
3094699643,49cyclictest10355-21ssh00:20:492
68292630,3sleep10-21swapper/100:15:561
68292630,3sleep10-21swapper/100:15:561
119882630,3sleep10-21swapper/100:21:421
71172610,9sleep227-21ksoftirqd/221:17:002
71172610,9sleep227-21ksoftirqd/221:17:002
3094699607,43cyclictest17870-21ssh22:05:502
3094699607,43cyclictest17870-21ssh22:05:502
205542600,4sleep10-21swapper/121:31:341
205542600,4sleep10-21swapper/121:31:341
3094699592,47cyclictest8862-21ssh21:55:502
3094699592,47cyclictest8862-21ssh21:55:502
3094699592,47cyclictest2701-21ssh23:00:502
3094699592,47cyclictest2701-21ssh23:00:502
250162570,2sleep125039-21sh23:25:411
250162570,2sleep125039-21sh23:25:411
72412550,3sleep00-21swapper/021:53:360
72412550,3sleep00-21swapper/021:53:360
33202540,2chrt0-21swapper/322:25:463
3094699516,7cyclictest131rcu_preempt23:10:492
3094699516,7cyclictest131rcu_preempt23:10:492
197672510,4sleep30-21swapper/322:06:573
197672510,4sleep30-21swapper/322:06:573
266052500,4chrt0-21swapper/000:01:200
266052500,4chrt0-21swapper/000:01:200
75272470,3sleep30-21swapper/321:17:383
75272470,3sleep30-21swapper/321:17:383
66532470,3sleep20-21swapper/223:40:482
3094699461,39cyclictest6696-21ssh23:40:532
3094599462,41cyclictest29775-21ssh23:30:511
3094599462,38cyclictest25306-21ssh23:25:521
3094599462,38cyclictest25306-21ssh23:25:521
308972450,3sleep130654-21ls19:11:061
308972450,3sleep130654-21ls19:11:061
28112440,4sleep10-21swapper/123:00:521
28112440,4sleep10-21swapper/123:00:521
17532440,3sleep10-21swapper/100:10:451
17532440,3sleep10-21swapper/100:10:451
149432440,2chrt0-21swapper/122:01:281
149432440,2chrt0-21swapper/122:01:281
3094699432,33cyclictest12509-21ssh22:35:512
3094699432,33cyclictest12509-21ssh22:35:512
3094599431,36cyclictest8049-21ssh22:30:521
3094599431,36cyclictest8049-21ssh22:30:521
3094599431,33cyclictest4373-21ssh21:50:511
3094599431,33cyclictest4373-21ssh21:50:511
311602420,2sleep231161-21cpu21:05:522
311602420,2sleep231161-21cpu21:05:522
81232410,2sleep20-21swapper/200:17:012
81232410,2sleep20-21swapper/200:17:012
106582410,1sleep0151rcuc/000:20:530
3094499401,36cyclictest1923-21sh23:35:490
3094499401,36cyclictest1923-21sh23:35:490
3094499401,36cyclictest1923-21sh23:35:490
191252400,3chrt0-21swapper/123:18:281
191252400,3chrt0-21swapper/123:18:281
3094699392,29cyclictest14526-21ssh00:25:502
3094699392,29cyclictest14526-21ssh00:25:502
229362390,3sleep00-21swapper/022:46:200
229362390,3sleep00-21swapper/022:46:200
3094699382,28cyclictest22340-21rm22:10:482
3094699382,28cyclictest22340-21rm22:10:482
3094599387,21cyclictest11356-21ssh23:45:551
3094599387,21cyclictest11356-21ssh23:45:551
81602370,3sleep30-21swapper/320:01:143
81602370,3sleep30-21swapper/320:01:143
3094699371,30cyclictest32718-21diskmemload23:15:512
3094699371,30cyclictest32718-21diskmemload23:15:512
30944993727,8cyclictest12-21ksoftirqd/022:00:510
30944993727,8cyclictest12-21ksoftirqd/022:00:510
74012360,2sleep27542-21cut23:05:532
74012360,2sleep27542-21cut23:05:532
30945993615,17cyclictest21-21ksoftirqd/120:00:521
30945993615,17cyclictest21-21ksoftirqd/120:00:521
3094499361,20cyclictest38850irq/55-eth021:30:480
3094499361,20cyclictest38850irq/55-eth021:30:480
72392350,2sleep00-21swapper/023:40:580
3094599353,23cyclictest6600-21apt-get23:40:491
291292350,2sleep129139-21ssh22:17:451
291292350,2sleep129139-21ssh22:17:451
12642350,3sleep30-21swapper/321:10:583
12642350,3sleep30-21swapper/321:10:583
35412340,2sleep03633-21fschecks_count22:25:520
35412340,2sleep03633-21fschecks_count22:25:520
3094799345,19cyclictest0-21swapper/300:20:493
3094699343,17cyclictest30963-21latency_hist22:20:492
3094699343,17cyclictest30963-21latency_hist22:20:492
3094599345,21cyclictest21-21ksoftirqd/121:40:491
3094599343,23cyclictest1927-21ssh23:35:501
3094599343,23cyclictest1927-21ssh23:35:501
3094599343,23cyclictest1927-21ssh23:35:501
278012340,2sleep00-21swapper/022:16:020
278012340,2sleep00-21swapper/022:16:020
242062340,3sleep00-21swapper/000:36:040
3094699334,18cyclictest18919-21ssh21:30:492
3094699334,18cyclictest18919-21ssh21:30:492
3094499332,17cyclictest38850irq/55-eth023:00:500
3094499332,17cyclictest38850irq/55-eth023:00:500
11072330,4sleep10-21swapper/122:58:431
326352320,3sleep00-21swapper/019:25:390
326352320,3sleep00-21swapper/019:25:390
3094599322,25cyclictest0-21swapper/100:00:511
3094599322,25cyclictest0-21swapper/100:00:511
3094499323,21cyclictest38850irq/55-eth020:15:510
3094499323,21cyclictest38850irq/55-eth020:15:510
30944993225,4cyclictest29766-21ssh23:30:500
3094499322,4cyclictest0-21swapper/023:45:550
3094499322,4cyclictest0-21swapper/023:45:550
298192320,4sleep30-21swapper/322:54:553
298192320,4sleep30-21swapper/322:54:553
245482320,2sleep30-21swapper/300:36:273
121252320,3sleep10-21swapper/120:12:581
121252320,3sleep10-21swapper/120:12:581
49012310,3chrt0-21swapper/100:13:421
49012310,3chrt0-21swapper/100:13:421
3094699311,21cyclictest7982-21sh22:30:482
3094599312,22cyclictest23044-21rm00:35:521
221142310,4sleep10-21swapper/122:45:571
221142310,4sleep10-21swapper/122:45:571
3094699301,22cyclictest645-21rm21:10:532
3094699301,22cyclictest645-21rm21:10:532
3094599303,20cyclictest18852-21ssh00:30:551
3094599303,20cyclictest18852-21ssh00:30:551
3094599301,22cyclictest32285-21ssh21:45:481
3094599301,22cyclictest32285-21ssh21:45:481
3094499305,19cyclictest38850irq/55-eth020:05:500
3094499305,19cyclictest38850irq/55-eth020:05:500
3094499303,23cyclictest27850-21ssh21:40:500
203412300,1sleep232718-21diskmemload22:44:222
80502290,4chrt0-21swapper/322:30:523
80502290,4chrt0-21swapper/322:30:523
3094699291,24cyclictest31116-21cat21:05:472
3094599291,24cyclictest31288-21ssh22:20:501
30944992915,9cyclictest5218-21ssh21:15:500
30944992915,9cyclictest5218-21ssh21:15:500
30944992913,10cyclictest0-21swapper/021:10:510
30944992913,10cyclictest0-21swapper/021:10:510
145382290,3sleep00-21swapper/021:25:540
145382290,3sleep00-21swapper/021:25:540
131892290,2sleep113199-21ssh23:11:221
131892290,2sleep113199-21ssh23:11:221
44752280,3sleep10-21swapper/119:52:491
3094799281,19cyclictest21487-21taskset22:45:513
3094799281,19cyclictest21487-21taskset22:45:513
3094699284,19cyclictest5256-21cat19:55:462
111172280,3sleep00-21swapper/021:57:370
111172280,3sleep00-21swapper/021:57:370
158882270,3sleep10-21swapper/100:26:121
158882270,3sleep10-21swapper/100:26:121
103412270,3sleep30-21swapper/300:20:483
80272260,3sleep130943-21cyclictest23:05:591
80272260,3sleep130943-21cyclictest23:05:591
3094499261,21cyclictest5257-21date19:55:460
30944992610,14cyclictest38950irq/56-eth023:20:580
30944992610,14cyclictest38950irq/56-eth023:20:580
3094499260,22cyclictest0-21swapper/021:45:490
3094499260,22cyclictest0-21swapper/021:45:490
242852260,2sleep30-21swapper/323:24:333
242852260,2sleep30-21swapper/323:24:333
3094499257,11cyclictest38850irq/55-eth023:25:530
3094499257,11cyclictest38850irq/55-eth023:25:530
3094799244,14cyclictest0-21swapper/322:20:493
3094799244,14cyclictest0-21swapper/322:20:493
3094699243,17cyclictest1938-21ssh23:35:502
3094699243,17cyclictest1938-21ssh23:35:502
3094699243,16cyclictest25558-21apt-get20:50:522
30946992411,10cyclictest26873-21cat00:40:462
3094599247,10cyclictest0-21swapper/120:40:511
3094599247,10cyclictest0-21swapper/120:40:511
30945992415,5cyclictest732-21runrttasks22:05:501
30945992415,5cyclictest732-21runrttasks22:05:501
30945992412,9cyclictest25649-21df20:50:541
21742240,4sleep0135-21systemd-journal19:40:380
21742240,4sleep0135-21systemd-journal19:40:380
99102230,4sleep30-21swapper/323:44:033
314472230,2sleep30-21swapper/323:31:413
3094799233,13cyclictest0-21swapper/321:55:503
3094799233,13cyclictest0-21swapper/321:55:503
3094699232,19cyclictest32456-21cut21:45:512
3094699232,19cyclictest32456-21cut21:45:512
30946992315,5cyclictest25978-21ssh23:26:012
30946992315,5cyclictest25978-21ssh23:26:012
30946992314,7cyclictest12159-21ssh21:22:342
30946992314,7cyclictest12159-21ssh21:22:342
3094699231,17cyclictest3359-21latency_hist22:25:472
3094499232,14cyclictest1877-21ssh00:10:500
3094499232,14cyclictest1877-21ssh00:10:500
164322230,2sleep10-21swapper/122:40:241
164322230,2sleep10-21swapper/122:40:241
30945992214,6cyclictest0-21swapper/121:05:421
30945992214,6cyclictest0-21swapper/121:05:421
3094499221,18cyclictest7594-21ls23:05:530
3094499221,18cyclictest7594-21ls23:05:530
3094499221,17cyclictest16403-21ls20:25:520
3094499221,17cyclictest16403-21ls20:25:520
3094499221,15cyclictest24427-21ls21:36:020
3094499221,15cyclictest24427-21ls21:36:020
3094499221,11cyclictest7011-21grep00:15:580
3094499221,11cyclictest7011-21grep00:15:580
3094499220,5cyclictest12498-21ssh22:35:500
3094499220,5cyclictest12498-21ssh22:35:500
308742222,13sleep230654-21ls19:10:512
308742222,13sleep230654-21ls19:10:512
3094799210,18cyclictest16467-21chrt23:15:533
3094799210,18cyclictest16467-21chrt23:15:533
3094699212,15cyclictest11351-21apt-get23:45:552
3094699212,15cyclictest11351-21apt-get23:45:552
3094699211,17cyclictest29925-21cut23:30:532
3094599211,12cyclictest732-21runrttasks20:26:351
3094599211,12cyclictest732-21runrttasks20:26:351
30944992112,7cyclictest15260-21ssh23:14:400
30944992112,7cyclictest15260-21ssh23:14:400
3094499211,18cyclictest1553-21ls00:10:380
3094499211,18cyclictest1553-21ls00:10:380
3094499211,17cyclictest16222-21find23:15:490
3094499211,17cyclictest16222-21find23:15:490
3094499211,14cyclictest6147-21ls19:56:030
3094499211,14cyclictest0-21swapper/022:50:590
3094499211,14cyclictest0-21swapper/022:50:590
30944992110,9cyclictest10689-21ps21:20:580
30944992110,9cyclictest10689-21ps21:20:580
158012210,4sleep30-21swapper/322:39:203
158012210,4sleep30-21swapper/322:39:203
66032200,4sleep30-21swapper/323:05:083
66032200,4sleep30-21swapper/323:05:083
3094799202,12cyclictest0-21swapper/321:45:493
3094799202,12cyclictest0-21swapper/321:45:493
3094699202,14cyclictest1878-21apt-get00:10:502
3094699202,14cyclictest1878-21apt-get00:10:502
30946992012,6cyclictest32718-21diskmemload21:52:262
30946992012,6cyclictest32718-21diskmemload21:52:262
3094699201,17cyclictest20244-21fschecks_time20:35:532
3094699201,17cyclictest20244-21fschecks_time20:35:532
3094699201,15cyclictest29702-21ssh00:05:512
3094699201,15cyclictest29702-21ssh00:05:512
3094699201,15cyclictest21477-21sh22:45:502
3094699201,15cyclictest21477-21sh22:45:502
3094699201,14cyclictest32580-21apt-get19:25:462
3094699201,14cyclictest32580-21apt-get19:25:462
3094599204,14cyclictest17196-21grep23:51:061
3094599204,11cyclictest438-21apt-get19:25:461
3094599204,11cyclictest438-21apt-get19:25:461
30945992011,7cyclictest0-21swapper/120:05:531
30945992011,7cyclictest0-21swapper/120:05:531
3094499208,10cyclictest12142-21ssh22:35:370
3094499208,10cyclictest12142-21ssh22:35:370
3094499202,15cyclictest31118-21dpkg21:05:470
30944992013,5cyclictest12-21ksoftirqd/023:51:060
3094499201,14cyclictest18245-21ssh22:41:060
3094499201,10cyclictest31690-21wc22:56:040
3094499201,10cyclictest28921-21apt21:00:370
3094499201,10cyclictest28921-21apt21:00:370
175862202,5sleep227-21ksoftirqd/221:29:072
175862202,5sleep227-21ksoftirqd/221:29:072
17342200,4sleep10-21swapper/119:35:451
17342200,4sleep10-21swapper/119:35:451
82342190,3sleep30-21swapper/323:06:013
82342190,3sleep30-21swapper/323:06:013
3094799193,11cyclictest0-21swapper/321:50:523
3094799193,11cyclictest0-21swapper/321:50:523
3094799192,11cyclictest0-21swapper/321:30:503
3094799192,11cyclictest0-21swapper/321:30:503
3094799192,11cyclictest0-21swapper/320:55:493
3094799192,11cyclictest0-21swapper/320:55:493
3094799192,11cyclictest0-21swapper/320:35:513
3094799192,11cyclictest0-21swapper/320:35:513
3094799191,13cyclictest0-21swapper/323:56:023
3094799191,13cyclictest0-21swapper/319:30:433
3094799191,13cyclictest0-21swapper/319:30:433
3094699194,12cyclictest19572-21sh00:31:032
3094699194,12cyclictest19572-21sh00:31:032
3094699191,9cyclictest10967-21fschecks_count20:10:552
3094699191,9cyclictest10967-21fschecks_count20:10:552
3094699191,14cyclictest23397-21sh21:35:502
3094699191,14cyclictest23397-21sh21:35:502
3094699190,17cyclictest14421-21timerandwakeup22:01:042
3094699190,17cyclictest14421-21timerandwakeup22:01:042
30945991913,4cyclictest2843-21latency_hist19:45:381
30945991913,4cyclictest2843-21latency_hist19:45:381
3094599191,10cyclictest2266-21latency_hist19:40:401
3094599191,10cyclictest2266-21latency_hist19:40:401
3094499196,11cyclictest18498-21gzip22:05:560
3094499196,11cyclictest18498-21gzip22:05:560
3094499192,13cyclictest38850irq/55-eth021:00:510
3094499191,9cyclictest25643-21ls20:50:540
3094499191,9cyclictest20537-21sh23:55:490
3094499191,8cyclictest23570-21grep22:11:000
3094499191,8cyclictest23570-21grep22:11:000
3094499191,4cyclictest0-21swapper/000:25:520
3094499191,4cyclictest0-21swapper/000:25:520
3094499191,15cyclictest14975-21ls20:20:580
3094499191,15cyclictest14975-21ls20:20:580
3094499191,12cyclictest21947-21ls20:40:530
3094499191,12cyclictest21947-21ls20:40:530
165922190,10sleep333-21ksoftirqd/321:27:303
165922190,10sleep333-21ksoftirqd/321:27:303
3094799182,11cyclictest0-21swapper/322:55:533
3094799182,11cyclictest0-21swapper/322:10:483
3094799182,11cyclictest0-21swapper/322:10:483
3094799182,11cyclictest0-21swapper/321:00:523
3094799182,11cyclictest0-21swapper/321:00:523
3094799182,11cyclictest0-21swapper/320:25:523
3094799182,11cyclictest0-21swapper/320:25:523
3094799182,11cyclictest0-21swapper/320:20:533
3094799182,11cyclictest0-21swapper/320:20:533
3094799182,11cyclictest0-21swapper/320:10:543
3094799182,11cyclictest0-21swapper/320:10:543
3094799181,12cyclictest0-21swapper/320:30:563
3094799181,12cyclictest0-21swapper/320:30:563
3094799181,11cyclictest0-21swapper/323:40:473
3094799181,11cyclictest0-21swapper/323:40:473
3094799181,11cyclictest0-21swapper/323:40:473
3094699181,9cyclictest19396-21vmstat20:31:072
3094699181,9cyclictest19396-21vmstat20:31:072
3094699181,9cyclictest1157-21sh22:58:482
3094699181,12cyclictest20572-21ssh23:55:512
3094699181,12cyclictest16069-21ssh23:50:552
3094699181,10cyclictest5412-21cut19:55:482
30946991810,6cyclictest0-21swapper/219:35:402
30946991810,6cyclictest0-21swapper/219:35:402
30946991810,5cyclictest0-21swapper/220:40:502
30946991810,5cyclictest0-21swapper/220:40:502
3094599185,11cyclictest28930-21cat21:00:371
3094599185,11cyclictest28930-21cat21:00:371
3094599182,14cyclictest16996-21rm22:40:541
30945991811,5cyclictest23828-21entropy20:45:521
30945991811,5cyclictest23828-21entropy20:45:521
30945991811,5cyclictest21770-21latency_hist20:40:451
30945991811,5cyclictest21770-21latency_hist20:40:451
3094599181,14cyclictest23359-21sshd22:10:591
3094599181,14cyclictest23359-21sshd22:10:591
3094599181,14cyclictest20560-21apt-get23:55:501
30945991810,6cyclictest3737-21sh21:13:501
30945991810,6cyclictest3737-21sh21:13:501
3094499181,8cyclictest32745-21date21:10:380
3094499181,8cyclictest32745-21date21:10:380
3094499181,8cyclictest20009-21/usr/sbin/munin20:36:010
3094499181,8cyclictest20009-21/usr/sbin/munin20:36:010
3094499181,7cyclictest19784-21wc20:35:380
3094499181,7cyclictest19784-21wc20:35:380
30944991812,4cyclictest0-21swapper/020:05:430
30944991812,4cyclictest0-21swapper/020:05:430
3094499181,15cyclictest38850irq/55-eth020:45:500
3094499181,15cyclictest38850irq/55-eth020:45:500
175942180,3sleep30-21swapper/300:29:123
175942180,3sleep30-21swapper/300:29:123
32112170,2sleep3321rcuc/300:11:073
32112170,2sleep3321rcuc/300:11:073
3094799172,9cyclictest0-21swapper/322:30:453
3094799172,9cyclictest0-21swapper/322:30:453
3094799172,11cyclictest0-21swapper/320:45:513
3094799172,11cyclictest0-21swapper/320:45:513
3094799172,11cyclictest0-21swapper/320:40:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional