You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 02:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot1.osadl.org (updated Sun Apr 05, 2026 22:46:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1788021570,4sleep30-21swapper/322:45:273
1788021570,4sleep30-21swapper/322:45:273
1788021570,4sleep30-21swapper/322:45:273
249321500,3sleep10-21swapper/121:23:311
249321500,3sleep10-21swapper/121:23:311
249321500,3sleep10-21swapper/121:23:311
996121380,7sleep19958-21find19:12:111
2898221050,1sleep012-21ksoftirqd/020:02:100
216222870,4sleep333-21ksoftirqd/321:42:343
216222870,4sleep333-21ksoftirqd/321:42:343
15072840,3sleep20-21swapper/221:56:352
15072840,3sleep20-21swapper/221:56:352
91812510,3sleep227-21ksoftirqd/222:36:582
91812510,3sleep227-21ksoftirqd/222:36:582
72522500,3sleep20-21swapper/222:01:582
72522500,3sleep20-21swapper/222:01:582
96662480,3sleep00-21swapper/019:12:070
60322480,2sleep10-21swapper/121:27:121
60322480,2sleep10-21swapper/121:27:121
324572480,3sleep30-21swapper/320:12:063
324572480,3sleep30-21swapper/320:12:063
264832470,3sleep10-21swapper/119:57:001
264832470,3sleep10-21swapper/119:57:001
99652460,3sleep210092-21cat19:12:132
288752460,3sleep30-21swapper/321:17:143
288752460,3sleep30-21swapper/321:17:143
111152430,3sleep30-21swapper/321:32:213
111152430,3sleep30-21swapper/321:32:213
304042420,2sleep230484-21strings20:07:032
304042420,2sleep230484-21strings20:07:032
259842410,3sleep210308-21cyclictest21:15:122
60492380,2sleep00-21swapper/022:33:110
60492380,2sleep00-21swapper/022:33:110
276982370,2sleep227706-21strings22:22:042
276982370,2sleep227706-21strings22:22:042
153612370,2sleep215465-21/usr/sbin/munin22:42:102
153612370,2sleep215465-21/usr/sbin/munin22:42:102
153612370,2sleep215465-21/usr/sbin/munin22:42:102
318982360,2sleep031959-21grep20:12:000
318982360,2sleep031959-21grep20:12:000
130822340,4sleep227-21ksoftirqd/222:07:122
130822340,4sleep227-21ksoftirqd/222:07:122
10311993424,8cyclictest21311-21find21:07:102
10311993424,8cyclictest21311-21find21:07:102
10309993410,6cyclictest73-21kswapd021:57:080
10309993410,6cyclictest73-21kswapd021:57:080
319132310,2sleep00-21swapper/021:21:040
319132310,2sleep00-21swapper/021:21:040
10311993116,6cyclictest73-21kswapd020:41:592
10311993116,6cyclictest73-21kswapd020:41:592
200912300,3sleep30-21swapper/322:15:013
200912300,3sleep30-21swapper/322:15:013
155512300,27sleep115561-21ssh22:10:541
155512300,27sleep115561-21ssh22:10:541
13562300,3sleep00-21swapper/022:28:370
324072290,3sleep30-21swapper/321:54:353
324072290,3sleep30-21swapper/321:54:353
201052280,2sleep020118-21sh22:15:030
201052280,2sleep020118-21sh22:15:030
112522280,3chrt0-21swapper/322:06:253
112522280,3chrt0-21swapper/322:06:253
1031199283,10cyclictest131rcu_preempt19:32:102
1031099274,4cyclictest131rcu_preempt21:12:111
283872260,4chrt0-21swapper/322:22:133
283872260,4chrt0-21swapper/322:22:133
196752260,3chrt0-21swapper/119:37:111
196752260,3chrt0-21swapper/119:37:111
196752260,3chrt0-21swapper/119:37:111
12062260,4chrt0-21swapper/321:22:083
12062260,4chrt0-21swapper/321:22:083
12062260,4chrt0-21swapper/321:22:083
10310992614,10cyclictest21018-21ntp_states21:07:061
10310992614,10cyclictest21018-21ntp_states21:07:061
10309992614,9cyclictest38650irq/55-eth020:17:010
10309992614,9cyclictest38650irq/55-eth020:17:010
226422250,3sleep00-21swapper/022:17:070
226422250,3sleep00-21swapper/022:17:070
10311992518,3cyclictest27-21ksoftirqd/221:47:012
10311992518,3cyclictest27-21ksoftirqd/221:47:012
1031199251,3cyclictest0-21swapper/219:47:192
1031199251,3cyclictest0-21swapper/219:27:102
1031199251,3cyclictest0-21swapper/219:27:102
1031099252,3cyclictest131rcu_preempt20:27:101
1030999259,7cyclictest73-21kswapd021:42:100
1030999259,7cyclictest73-21kswapd021:42:100
257802240,3sleep025785-21unixbench_singl21:47:130
257802240,3sleep025785-21unixbench_singl21:47:130
1031099241,4cyclictest0-21swapper/119:32:101
10310992413,9cyclictest24474-21/usr/sbin/munin21:47:041
10310992413,9cyclictest24474-21/usr/sbin/munin21:47:041
1030999242,17cyclictest1145-21ssh21:22:070
1030999242,17cyclictest1145-21ssh21:22:070
1030999242,17cyclictest1145-21ssh21:22:070
10309992416,6cyclictest29932-21ssh21:52:050
10309992416,6cyclictest29932-21ssh21:52:050
98232231,16sleep30-21swapper/319:12:103
43762230,4sleep30-21swapper/321:58:293
43762230,4sleep30-21swapper/321:58:293
1031199231,20cyclictest7655-21ls22:02:042
1031199231,20cyclictest7655-21ls22:02:042
10310992315,6cyclictest28675-21ntp_states20:02:051
10310992315,4cyclictest21-21ksoftirqd/119:52:091
10310992315,4cyclictest21-21ksoftirqd/119:52:091
1031099230,4cyclictest11788-21find20:42:101
1031099230,4cyclictest11788-21find20:42:101
10309992317,4cyclictest38650irq/55-eth022:07:100
10309992317,4cyclictest38650irq/55-eth022:07:100
147332220,3sleep014463-21latency_hist21:36:560
10311992215,5cyclictest24080-21ssh22:18:232
10311992215,5cyclictest24080-21ssh22:18:232
1031199221,3cyclictest0-21swapper/219:57:092
1031199221,3cyclictest0-21swapper/219:57:092
1031199221,18cyclictest16905-21ls22:12:012
1031199221,18cyclictest16905-21ls22:12:012
1031199220,3cyclictest21090-21find21:42:102
1031199220,3cyclictest21090-21find21:42:102
1031099221,2cyclictest131rcu_preempt20:32:091
1031099221,2cyclictest131rcu_preempt20:32:091
1031099221,18cyclictest4046-21grep22:32:001
1031099221,18cyclictest4046-21grep22:32:001
1031099221,18cyclictest20766-21ls19:42:001
1031099221,18cyclictest20766-21ls19:42:001
1031099221,11cyclictest14738-21fschecks_time22:42:011
1031099221,11cyclictest14738-21fschecks_time22:42:011
1031099221,11cyclictest14738-21fschecks_time22:42:011
1030999228,4cyclictest131rcu_preempt19:17:120
1030999228,4cyclictest131rcu_preempt19:17:120
1030999227,13cyclictest31681-21fschecks_count22:26:590
10309992214,6cyclictest11573-21ssh22:38:290
10309992214,6cyclictest11573-21ssh22:38:290
1030999221,19cyclictest8349-21find22:02:130
1030999221,19cyclictest8349-21find22:02:130
27972210,2sleep123360-21snmpd20:20:481
27972210,2sleep123360-21snmpd20:20:481
1031199211,11cyclictest2890-21latency_hist20:21:532
1031199211,11cyclictest2890-21latency_hist20:21:532
1031199211,10cyclictest5066-21fschecks_count21:27:012
1031199211,10cyclictest5066-21fschecks_count21:27:012
1031099215,3cyclictest30884-21taskset20:07:111
1031099215,3cyclictest30884-21taskset20:07:111
1031099212,3cyclictest131rcu_preempt22:17:101
1031099212,3cyclictest131rcu_preempt22:17:101
10310992113,6cyclictest0-21swapper/121:37:011
10310992113,6cyclictest0-21swapper/121:37:011
10310992113,6cyclictest0-21swapper/121:37:011
1031099211,2cyclictest131rcu_preempt21:42:111
1031099211,2cyclictest131rcu_preempt21:42:111
1031099211,18cyclictest14623-21find20:51:591
1031099211,17cyclictest23287-21find19:47:101
10310992110,9cyclictest3348-21fschecks_count20:21:591
10310992110,9cyclictest3348-21fschecks_count20:21:591
1030999219,10cyclictest14156-21ssh21:36:250
1030999212,6cyclictest29519-21kworker/0:120:07:100
1030999212,6cyclictest29519-21kworker/0:120:07:100
1030999212,5cyclictest131rcu_preempt21:12:110
10309992116,3cyclictest24280-1kworker/0:1H19:37:000
10309992116,3cyclictest24280-1kworker/0:1H19:37:000
10309992116,3cyclictest24280-1kworker/0:1H19:37:000
10309992113,6cyclictest38750irq/56-eth021:37:110
10309992113,6cyclictest38750irq/56-eth021:37:110
10309992113,6cyclictest38750irq/56-eth021:37:110
1030999211,17cyclictest3929-21proc_pri20:22:060
1030999211,17cyclictest3929-21proc_pri20:22:060
314602200,3sleep10-21swapper/121:53:211
314602200,3sleep10-21swapper/121:53:211
282862200,3sleep20-21swapper/220:02:002
1031199201,17cyclictest7202-21cut20:31:592
1031199201,17cyclictest7202-21cut20:31:592
1031099201,5cyclictest17489-21xargs20:57:091
1031099201,5cyclictest17489-21xargs20:57:091
10310992012,6cyclictest0-21swapper/122:12:061
10310992012,6cyclictest0-21swapper/122:12:061
1031099201,16cyclictest27307-21cut22:22:001
1031099201,16cyclictest27307-21cut22:22:001
1031099200,5cyclictest73-21kswapd019:27:101
1031099200,5cyclictest73-21kswapd019:27:101
1030999208,9cyclictest14782-21perl22:42:020
1030999208,9cyclictest14782-21perl22:42:020
1030999208,9cyclictest14782-21perl22:42:020
1030999207,3cyclictest131rcu_preempt20:56:590
1030999207,3cyclictest131rcu_preempt20:56:590
10309992014,4cyclictest0-21swapper/021:07:000
10309992014,4cyclictest0-21swapper/021:07:000
10309992013,4cyclictest151rcuc/019:57:100
10309992013,4cyclictest151rcuc/019:57:100
10309992012,6cyclictest28122-21ssh22:22:110
1030999201,17cyclictest25170-21find19:52:090
1030999201,17cyclictest25170-21find19:52:090
1031399191,14cyclictest0-21swapper/322:17:113
1031399191,14cyclictest0-21swapper/322:17:113
1031399191,13cyclictest0-21swapper/320:56:563
1031399191,13cyclictest0-21swapper/319:42:023
1031399191,13cyclictest0-21swapper/319:42:023
1031399191,12cyclictest0-21swapper/319:56:573
1031399191,12cyclictest0-21swapper/319:56:573
1031399191,11cyclictest0-21swapper/320:31:593
1031399191,11cyclictest0-21swapper/320:31:593
1031199197,9cyclictest32183-21kernelversion20:12:022
1031199197,9cyclictest32183-21kernelversion20:12:022
1031199197,3cyclictest141rcub/021:02:112
1031199197,3cyclictest141rcub/021:02:112
10311991912,5cyclictest0-21swapper/222:27:082
1031199191,15cyclictest5404-21fschecks_time20:27:012
1031199191,15cyclictest17126-21cut20:57:032
1031199191,15cyclictest17126-21cut20:57:032
1031199191,15cyclictest15883-21find21:37:102
1031199191,15cyclictest15883-21find21:37:102
1031199191,15cyclictest15883-21find21:37:102
10311991911,5cyclictest0-21swapper/219:41:562
10311991911,5cyclictest0-21swapper/219:41:562
1031099199,7cyclictest12934-21awk19:21:591
1031099199,7cyclictest12934-21awk19:21:591
1031099191,7cyclictest27757-21ssh21:17:021
1031099191,7cyclictest27757-21ssh21:17:021
1031099191,5cyclictest0-21swapper/120:12:441
1031099191,5cyclictest0-21swapper/120:12:441
10310991912,3cyclictest10695-21xargs21:32:111
10310991912,3cyclictest10695-21xargs21:32:111
1030999191,8cyclictest5936-21ls21:27:120
1030999191,8cyclictest5936-21ls21:27:120
1030999191,16cyclictest13029-21gltestperf20:46:590
1030999191,16cyclictest13029-21gltestperf20:46:590
1031399181,14cyclictest0-21swapper/319:51:503
1031399181,13cyclictest0-21swapper/321:51:473
1031399181,13cyclictest0-21swapper/321:51:473
1031399181,13cyclictest0-21swapper/320:22:013
1031399181,13cyclictest0-21swapper/320:22:013
1031399181,11cyclictest0-21swapper/321:06:583
1031399181,11cyclictest0-21swapper/321:06:583
1031199185,10cyclictest10804-21latency_hist20:41:562
1031199185,10cyclictest10804-21latency_hist20:41:562
1031199181,8cyclictest10929-21/usr/sbin/munin19:17:002
1031199181,8cyclictest10929-21/usr/sbin/munin19:17:002
10311991812,4cyclictest27-21ksoftirqd/221:17:022
10311991812,4cyclictest27-21ksoftirqd/221:17:022
10311991812,4cyclictest0-21swapper/219:52:112
10311991812,4cyclictest0-21swapper/219:52:112
1031199181,15cyclictest22124-21ls19:46:472
1031199181,15cyclictest22124-21ls19:46:472
1031199181,14cyclictest10506-21ps21:32:082
1031199181,14cyclictest10506-21ps21:32:082
1031099181,7cyclictest9537-21basename22:37:011
1031099181,7cyclictest9537-21basename22:37:011
1031099181,2cyclictest131rcu_preempt22:02:131
1031099181,2cyclictest131rcu_preempt22:02:131
1030999185,4cyclictest131rcu_preempt19:22:000
1030999185,4cyclictest131rcu_preempt19:22:000
1030999183,12cyclictest0-21swapper/021:02:120
1030999183,12cyclictest0-21swapper/021:02:120
1030999182,13cyclictest14911-21gltestperf20:52:010
1030999181,8cyclictest8727-21latency_hist20:36:490
1030999181,8cyclictest8727-21latency_hist20:36:490
1030999181,15cyclictest15632-21switchtime19:27:090
1030999181,15cyclictest15632-21switchtime19:27:090
1030999181,14cyclictest11565-21proc_pri20:42:060
1030999181,14cyclictest11565-21proc_pri20:42:060
1031399171,14cyclictest0-21swapper/322:27:083
1031199178,7cyclictest14608-21date20:51:562
1031199176,9cyclictest13057-21fschecks_time19:22:002
1031199176,9cyclictest13057-21fschecks_time19:22:002
1031199172,4cyclictest131rcu_preempt21:22:112
1031199172,4cyclictest131rcu_preempt21:22:112
1031199172,4cyclictest131rcu_preempt21:22:112
1031199171,14cyclictest18836-21gltestperf19:37:012
10311991711,4cyclictest13231-21missed_timers20:47:012
10311991711,4cyclictest13231-21missed_timers20:47:012
1031199171,13cyclictest3862-21seq20:22:042
1031199171,13cyclictest3862-21seq20:22:042
10311991710,5cyclictest0-21swapper/222:34:572
10311991710,5cyclictest0-21swapper/222:34:572
1031099178,7cyclictest2806-21ssh21:57:061
1031099178,7cyclictest2806-21ssh21:57:061
1031099172,9cyclictest0-21swapper/120:37:101
1031099172,9cyclictest0-21swapper/120:37:101
1031099172,4cyclictest141rcub/019:17:121
1031099172,4cyclictest141rcub/019:17:121
10310991710,5cyclictest32591-21ssh22:27:091
1030999173,12cyclictest20914-21cat19:42:010
1030999173,12cyclictest20914-21cat19:42:010
1030999172,12cyclictest6072-21threads20:27:090
1030999171,6cyclictest17771-21grep19:32:110
10309991712,3cyclictest23004-21ntp_states19:47:060
1031399161,13cyclictest0-21swapper/320:57:103
1031399161,13cyclictest0-21swapper/320:57:103
1031399161,10cyclictest0-21swapper/322:36:583
1031399161,10cyclictest0-21swapper/322:36:583
1031399161,10cyclictest0-21swapper/319:32:023
1031099161,10cyclictest18639-21grep21:02:021
1031099161,10cyclictest18639-21grep21:02:021
1030999161,13cyclictest9103-21fschecks_count20:37:020
1030999161,13cyclictest9103-21fschecks_count20:37:020
198642151,3sleep30-21swapper/321:04:083
198642151,3sleep30-21swapper/321:04:083
18332150,4sleep30-21swapper/320:17:053
18332150,4sleep30-21swapper/320:17:053
1031399151,9cyclictest0-21swapper/320:37:133
1031399151,9cyclictest0-21swapper/320:37:133
1031399151,9cyclictest0-21swapper/319:22:003
1031399151,9cyclictest0-21swapper/319:22:003
1031399151,12cyclictest0-21swapper/322:31:583
1031399151,12cyclictest0-21swapper/322:31:583
1031399151,11cyclictest22446-21chrt21:11:593
1031099151,12cyclictest12900-21grep20:46:581
1031099151,12cyclictest12900-21grep20:46:581
202242140,4sleep30-21swapper/319:41:473
202242140,4sleep30-21swapper/319:41:473
202242140,4sleep30-21swapper/319:41:473
156022140,3sleep30-21swapper/321:37:073
156022140,3sleep30-21swapper/321:37:073
156022140,3sleep30-21swapper/321:37:073
1031399131,9cyclictest6669-21chrt21:27:553
1031399131,9cyclictest6669-21chrt21:27:553
1031399131,9cyclictest15601-21chrt19:27:093
1031399131,9cyclictest15601-21chrt19:27:093
1031399131,9cyclictest13035-21chrt20:46:593
1031399131,9cyclictest13035-21chrt20:46:593
1031399131,9cyclictest11488-21chrt19:17:043
1031399131,9cyclictest11488-21chrt19:17:043
1031399131,7cyclictest0-21swapper/320:46:473
1031399131,7cyclictest0-21swapper/320:46:473
1031399131,10cyclictest14297-21chrt22:09:063
1031399131,10cyclictest14297-21chrt22:09:063
1031399130,11cyclictest28979-21chrt20:02:093
1031399126,4cyclictest33-21ksoftirqd/320:28:423
1031399122,7cyclictest0-21swapper/319:52:083
1031399122,7cyclictest0-21swapper/319:52:083
1031399121,6cyclictest300362sleep320:06:593
1031399121,6cyclictest300362sleep320:06:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional