You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 07:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat May 30, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
345621230,2sleep20-21swapper/222:57:492
345621230,2sleep20-21swapper/222:57:492
1210121120,3sleep20-21swapper/220:27:462
1210121120,3sleep20-21swapper/220:27:462
26442990,4sleep20-21swapper/220:02:412
26442990,4sleep20-21swapper/220:02:412
144082980,3sleep20-21swapper/221:57:592
292082810,1chrt27708-40mandb00:03:241
292082810,1chrt27708-40mandb00:03:241
30162650,3sleep20-21swapper/220:02:502
30162650,3sleep20-21swapper/220:02:502
73962600,3sleep20-21swapper/220:12:592
54782580,2chrt5475-21df23:02:501
54782580,2chrt5475-21df23:02:501
54782580,2chrt5475-21df23:02:501
124112570,4chrt12413-21wc21:52:580
124112570,4chrt12413-21wc21:52:580
252422500,3sleep20-21swapper/223:53:002
252422500,3sleep20-21swapper/223:53:002
208922480,1sleep00-21swapper/022:17:470
208922480,1sleep00-21swapper/022:17:470
229962450,2sleep00-21swapper/019:27:580
229962450,2sleep00-21swapper/019:27:580
66832440,3sleep20-21swapper/200:32:482
66832440,3sleep20-21swapper/200:32:482
228682440,3sleep20-21swapper/219:27:572
228682440,3sleep20-21swapper/219:27:572
76892410,1sleep00-21swapper/021:42:410
76892410,1sleep00-21swapper/021:42:410
79712400,3sleep016960-21cyclictest00:33:020
79712400,3sleep016960-21cyclictest00:33:020
66482400,3sleep30-21swapper/321:37:583
66482400,3sleep30-21swapper/321:37:583
1697399391,28cyclictest27794-21chrt00:02:452
1697399391,28cyclictest27794-21chrt00:02:452
1697399391,28cyclictest27794-21chrt00:02:452
79372380,3sleep20-21swapper/221:42:512
79372380,3sleep20-21swapper/221:42:512
16968993629,5cyclictest16648-21cpu23:32:490
16968993629,5cyclictest16648-21cpu23:32:490
16968993629,5cyclictest16648-21cpu23:32:490
16968993629,4cyclictest28249-21gltestperf00:02:530
16968993629,4cyclictest28249-21gltestperf00:02:530
196082350,2sleep119709-21memory22:12:541
196082350,2sleep119709-21memory22:12:541
16971993530,3cyclictest4950-21grep20:07:531
16971993530,3cyclictest4950-21grep20:07:531
16971993530,3cyclictest4950-21grep20:07:531
16968993529,5cyclictest26183-21gltestperf19:37:520
16968993529,5cyclictest26183-21gltestperf19:37:520
233202340,3sleep0171ktimers/022:22:530
233202340,3sleep0171ktimers/022:22:530
187412340,2sleep118878-21timerandwakeup20:43:021
187412340,2sleep118878-21timerandwakeup20:43:021
187412340,2sleep118878-21timerandwakeup20:43:021
16968993328,3cyclictest5924-21timerwakeupswit00:28:030
16968993328,3cyclictest5924-21timerwakeupswit00:28:030
16968993328,3cyclictest15144-21cron22:02:390
1697599321,24cyclictest27802-21chrt00:02:463
1697599321,24cyclictest27802-21chrt00:02:463
1697599321,24cyclictest27802-21chrt00:02:463
16971993227,4cyclictest547-21rs:main1
16971993227,4cyclictest547-21rs:main1
16971993227,4cyclictest547-21rs:main1
16968993224,6cyclictest32393-21fschecks_time22:47:510
16968993224,6cyclictest32393-21fschecks_time22:47:510
240082310,3sleep116960-21cyclictest23:52:431
240082310,3sleep116960-21cyclictest23:52:431
16971993125,5cyclictest18683-21fschecks_count23:37:521
16971993125,4cyclictest9695-21latency_hist21:47:491
16971993125,4cyclictest9695-21latency_hist21:47:491
16968993126,4cyclictest9670-21kernelversion23:12:530
16968993126,4cyclictest9670-21kernelversion23:12:530
16968993125,5cyclictest1764-21netstat00:17:560
16968993125,5cyclictest1764-21netstat00:17:560
16971993025,4cyclictest10094-21gltestperf21:47:541
16971993025,4cyclictest10094-21gltestperf21:47:541
16971993025,3cyclictest22856-21ntp_kernel_err19:27:561
16971993025,3cyclictest22856-21ntp_kernel_err19:27:561
16971993023,5cyclictest26870-21sshd19:38:011
16971993023,5cyclictest26870-21sshd19:38:011
16971993023,4cyclictest0-21swapper/100:22:501
16971993023,4cyclictest0-21swapper/100:22:501
16968993026,3cyclictest17172-21kernelversion23:32:530
16968993026,3cyclictest17172-21kernelversion23:32:530
16968993026,3cyclictest17172-21kernelversion23:32:530
16968993025,4cyclictest1346-21avahi-daemon23:52:590
16968993025,4cyclictest1346-21avahi-daemon23:52:590
16968993024,4cyclictest0-21swapper/023:43:010
16968993024,4cyclictest0-21swapper/023:43:010
16968993024,4cyclictest0-21swapper/023:43:010
16968993023,5cyclictest29966-21sshd22:41:010
16968993023,5cyclictest29966-21sshd22:41:010
16968993023,5cyclictest28674-21sshd21:11:010
16968993023,5cyclictest28674-21sshd21:11:010
16968993022,6cyclictest0-21swapper/000:02:450
16968993022,6cyclictest0-21swapper/000:02:450
16968993022,6cyclictest0-21swapper/000:02:450
16971992925,3cyclictest5966-21latency23:02:541
16971992925,3cyclictest5966-21latency23:02:541
16971992925,3cyclictest5966-21latency23:02:541
16971992925,3cyclictest3432-21latency_hist22:57:481
16971992925,3cyclictest3432-21latency_hist22:57:481
16971992925,2cyclictest0-21swapper/120:42:381
16971992925,2cyclictest0-21swapper/120:42:381
16971992924,4cyclictest7536-21fschecks_time23:07:551
16971992924,4cyclictest7536-21fschecks_time23:07:551
16971992923,4cyclictest28800-21gltestperf22:37:541
16971992923,4cyclictest28800-21gltestperf22:37:541
16971992923,4cyclictest15743-21gltestperf22:02:521
16971992923,4cyclictest15743-21gltestperf22:02:521
16971992923,4cyclictest0-21swapper/119:42:561
16971992923,4cyclictest0-21swapper/119:42:561
16971992923,4cyclictest0-21swapper/119:42:561
16971992922,5cyclictest12106-21kernelversion21:52:541
16971992922,5cyclictest12106-21kernelversion21:52:541
16971992922,5cyclictest10340-21unixbench_multi23:13:011
16971992922,5cyclictest10340-21unixbench_multi23:13:011
16971992921,6cyclictest23190-21gltestperf22:22:521
16971992921,6cyclictest23190-21gltestperf22:22:521
16971992921,6cyclictest12382-21sshd23:19:011
16968992925,3cyclictest2276-21cpu21:27:510
16968992925,3cyclictest2276-21cpu21:27:510
16968992925,2cyclictest0-21swapper/022:08:020
16968992925,2cyclictest0-21swapper/022:08:020
16968992924,3cyclictest1713-21proc_pri19:57:590
16968992924,3cyclictest1713-21proc_pri19:57:590
16968992923,5cyclictest8820-21switchtime21:43:010
16968992923,5cyclictest8820-21switchtime21:43:010
16968992923,5cyclictest26827-21cut22:32:500
16968992923,5cyclictest26827-21cut22:32:500
16968992923,4cyclictest2417-21fschecks_count21:27:520
16968992923,4cyclictest2417-21fschecks_count21:27:520
16968992922,5cyclictest5100-21threads21:32:590
16968992922,5cyclictest5100-21threads21:32:590
16968992922,5cyclictest5100-21threads21:32:590
251832280,5sleep1281ktimers/119:33:021
251832280,5sleep1281ktimers/119:33:021
251832280,5sleep1281ktimers/119:33:021
251832280,5sleep1281ktimers/119:33:021
16971992824,3cyclictest31073-21ntp_kernel_pll_22:42:571
16971992824,3cyclictest31073-21ntp_kernel_pll_22:42:571
16971992824,2cyclictest0-21swapper/121:37:391
16971992824,2cyclictest0-21swapper/121:37:391
16971992824,2cyclictest0-21swapper/121:37:391
16971992823,4cyclictest22722-21unixbench-2d20:53:011
16971992823,4cyclictest22722-21unixbench-2d20:53:011
16971992823,3cyclictest8918-21head00:37:531
16971992823,3cyclictest8918-21head00:37:531
16971992823,3cyclictest24282-21fschecks_count23:52:511
16971992823,3cyclictest24282-21fschecks_count23:52:511
16971992823,2cyclictest0-21swapper/100:12:391
16971992823,2cyclictest0-21swapper/100:12:391
16971992823,2cyclictest0-21swapper/100:12:391
16971992822,3cyclictest0-21swapper/120:47:521
16971992822,3cyclictest0-21swapper/120:47:521
16971992821,5cyclictest21921-21latency_hist19:27:401
16971992821,5cyclictest13305-21timerwakeupswit20:28:011
16971992821,5cyclictest13305-21timerwakeupswit20:28:011
16971992821,5cyclictest0-21swapper/100:02:401
16971992821,5cyclictest0-21swapper/100:02:401
16971992821,5cyclictest0-21swapper/100:02:401
16968992822,5cyclictest8759-21fschecks_count00:37:520
16968992822,5cyclictest8759-21fschecks_count00:37:520
16968992822,5cyclictest22233-21needreboot20:52:560
16968992822,5cyclictest22233-21needreboot20:52:560
16971992722,4cyclictest14678-21systemd-journal23:38:011
16971992722,4cyclictest14678-21systemd-journal23:38:011
16971992722,4cyclictest14678-21systemd-journal23:38:011
16971992722,3cyclictest9154-21ntp_kernel_err20:17:571
16971992722,3cyclictest21293-21sendmail_mailqu23:43:001
16971992722,3cyclictest21293-21sendmail_mailqu23:43:001
16971992722,3cyclictest21293-21sendmail_mailqu23:43:001
16971992721,4cyclictest880-21timerwakeupswit22:48:011
16971992721,4cyclictest880-21timerwakeupswit22:48:011
16971992721,4cyclictest880-21timerwakeupswit22:48:011
16971992721,4cyclictest13088-21fschecks_count23:22:501
16971992721,4cyclictest13088-21fschecks_count23:22:501
16971992721,4cyclictest0-21swapper/121:32:491
16971992721,4cyclictest0-21swapper/121:32:491
16971992720,4cyclictest0-21swapper/119:52:511
16971992720,4cyclictest0-21swapper/119:52:511
16968992723,2cyclictest0-21swapper/000:07:540
16968992723,2cyclictest0-21swapper/000:07:540
16968992723,2cyclictest0-21swapper/000:07:540
16968992721,5cyclictest4602-21latency_hist00:27:390
16968992721,5cyclictest4602-21latency_hist00:27:390
16968992721,5cyclictest4602-21latency_hist00:27:390
16968992721,5cyclictest1599-21unixbench_singl21:23:020
16968992719,6cyclictest26290-21ls21:03:000
16968992719,6cyclictest26290-21ls21:03:000
16968992719,6cyclictest26290-21ls21:03:000
16971992622,2cyclictest0-21swapper/121:02:391
16971992622,2cyclictest0-21swapper/121:02:391
16971992621,3cyclictest14465-21idleruntime20:32:531
16971992621,3cyclictest0-21swapper/121:18:011
16971992621,3cyclictest0-21swapper/121:18:011
16971992620,5cyclictest6350-21sshd00:31:011
16971992620,5cyclictest6350-21sshd00:31:011
16971992620,5cyclictest21836-21rt-features22:17:591
16971992620,5cyclictest21836-21rt-features22:17:591
16971992620,5cyclictest21836-21rt-features22:17:591
16971992620,4cyclictest3820-21timerandwakeup20:02:591
16971992620,4cyclictest3820-21timerandwakeup20:02:591
16971992619,5cyclictest0-21swapper/122:37:411
16971992619,5cyclictest0-21swapper/122:37:411
16971992619,4cyclictest0-21swapper/121:57:561
16971992618,6cyclictest8436-21latency_hist00:37:431
16971992618,6cyclictest8436-21latency_hist00:37:431
16971992618,6cyclictest10572-21fschecks_time20:22:511
16971992618,6cyclictest10572-21fschecks_time20:22:511
16971992610,5cyclictest29-21ksoftirqd/121:07:531
16971992610,5cyclictest29-21ksoftirqd/121:07:531
16968992622,2cyclictest0-21swapper/023:42:500
16968992622,2cyclictest0-21swapper/023:42:500
16968992622,2cyclictest0-21swapper/021:18:000
16968992622,2cyclictest0-21swapper/021:18:000
16968992622,2cyclictest0-21swapper/020:22:580
16968992622,2cyclictest0-21swapper/020:22:580
16968992621,3cyclictest0-21swapper/022:03:010
16968992621,3cyclictest0-21swapper/022:03:010
16968992620,5cyclictest6545-21cpu20:12:490
16968992620,5cyclictest6545-21cpu20:12:490
16968992620,5cyclictest21281-21sshd20:52:010
16968992620,5cyclictest21281-21sshd20:52:010
16968992620,5cyclictest10244-21kernelversion21:47:550
16968992620,5cyclictest10244-21kernelversion21:47:550
16971992521,2cyclictest0-21swapper/123:27:521
16971992521,2cyclictest0-21swapper/123:27:521
16971992521,2cyclictest0-21swapper/123:27:521
16971992521,2cyclictest0-21swapper/122:12:391
16971992521,2cyclictest0-21swapper/122:12:391
16971992519,4cyclictest0-21swapper/123:37:391
16971992519,4cyclictest0-21swapper/123:37:391
16971992519,4cyclictest0-21swapper/121:38:011
16971992519,4cyclictest0-21swapper/121:38:011
16971992519,4cyclictest0-21swapper/120:02:391
16971992519,4cyclictest0-21swapper/120:02:391
16971992518,5cyclictest0-21swapper/120:17:391
16971992518,4cyclictest0-21swapper/122:27:521
16971992518,4cyclictest0-21swapper/122:27:521
16971992511,3cyclictest181rcu_preempt00:13:101
16971992511,3cyclictest181rcu_preempt00:13:101
16971992511,3cyclictest181rcu_preempt00:13:101
16968992521,2cyclictest0-21swapper/023:17:500
16968992521,2cyclictest0-21swapper/000:13:040
16968992521,2cyclictest0-21swapper/000:13:040
16968992521,2cyclictest0-21swapper/000:13:040
16968992520,3cyclictest8698-21gltestperf20:17:520
16968992518,5cyclictest23910-21kernelversion20:57:540
16968992518,5cyclictest23910-21kernelversion20:57:540
16968992518,5cyclictest1581-21/usr/sbin/munin22:52:580
16968992518,5cyclictest1581-21/usr/sbin/munin22:52:580
16968992518,5cyclictest12446-21fschecks_time20:27:520
16968992518,5cyclictest12446-21fschecks_time20:27:520
12002250,2chrt0-21swapper/319:57:523
12002250,2chrt0-21swapper/319:57:523
16971992420,2cyclictest0-21swapper/121:13:001
16971992420,2cyclictest0-21swapper/121:13:001
16971992416,5cyclictest0-21swapper/121:23:031
16971992416,5cyclictest0-21swapper/121:23:031
16971992416,5cyclictest0-21swapper/121:23:031
16971992416,5cyclictest0-21swapper/119:47:581
16971992416,5cyclictest0-21swapper/119:47:581
16968992420,2cyclictest0-21swapper/022:27:590
16968992420,2cyclictest0-21swapper/022:27:590
16968992420,2cyclictest0-21swapper/019:42:590
16968992420,2cyclictest0-21swapper/019:42:590
16968992420,2cyclictest0-21swapper/019:42:590
16968992419,4cyclictest13591-21needreboot23:22:550
16968992419,4cyclictest13591-21needreboot23:22:550
16968992419,3cyclictest0-21swapper/023:48:000
16968992419,3cyclictest0-21swapper/023:48:000
16968992418,4cyclictest0-21swapper/023:03:010
16968992418,4cyclictest0-21swapper/023:03:010
16968992418,4cyclictest0-21swapper/023:03:010
16968992418,4cyclictest0-21swapper/022:58:020
16968992418,4cyclictest0-21swapper/022:58:020
16968992418,4cyclictest0-21swapper/022:58:020
16968992418,4cyclictest0-21swapper/021:13:010
16968992418,4cyclictest0-21swapper/021:13:010
16968992417,6cyclictest21647-21head22:17:560
16968992417,6cyclictest21647-21head22:17:560
16968992417,6cyclictest21647-21head22:17:560
16968992417,5cyclictest32152-21needreboot19:52:560
16968992417,5cyclictest32152-21needreboot19:52:560
16968992417,5cyclictest25205-21unixbench_multi19:33:020
16968992417,5cyclictest25205-21unixbench_multi19:33:020
16968992417,5cyclictest25205-21unixbench_multi19:33:020
16968992417,5cyclictest25205-21unixbench_multi19:33:020
16968992417,5cyclictest18824-21gltestperf23:37:530
16968992416,6cyclictest30998-21sshd19:49:230
16968992416,6cyclictest30998-21sshd19:49:230
16975992317,4cyclictest89642sleep323:12:423
16975992317,4cyclictest89642sleep323:12:423
16968992319,2cyclictest0-21swapper/023:08:040
16968992319,2cyclictest0-21swapper/023:08:040
16968992318,4cyclictest735-21systemd-logind20:12:590
16968992318,3cyclictest0-21swapper/020:07:560
16968992317,4cyclictest0-21swapper/019:23:000
16968992218,2cyclictest0-21swapper/022:52:520
16968992218,2cyclictest0-21swapper/022:52:520
16968992217,3cyclictest0-21swapper/020:38:010
16968992217,3cyclictest0-21swapper/020:38:010
16971992115,4cyclictest0-21swapper/100:22:571
16971992115,4cyclictest0-21swapper/100:22:571
16971992115,4cyclictest0-21swapper/100:22:571
16968992116,3cyclictest0-21swapper/020:32:530
1697399204,12cyclictest0-21swapper/221:18:012
1697399204,12cyclictest0-21swapper/221:18:012
1697399203,14cyclictest0-21swapper/200:02:522
1697399203,14cyclictest0-21swapper/200:02:522
1697399203,13cyclictest0-21swapper/219:48:012
1697399203,13cyclictest0-21swapper/219:48:012
16968992014,4cyclictest0-21swapper/020:42:510
16968992014,4cyclictest0-21swapper/020:42:510
16968992014,4cyclictest0-21swapper/020:42:510
326722190,4sleep30-21swapper/319:53:023
326722190,4sleep30-21swapper/319:53:023
234062190,3sleep30-21swapper/319:28:013
234062190,3sleep30-21swapper/319:28:013
1697599193,11cyclictest0-21swapper/300:02:533
1697599193,11cyclictest0-21swapper/300:02:533
1697399192,11cyclictest0-21swapper/222:13:012
1697399192,11cyclictest0-21swapper/222:13:012
16973991913,3cyclictest188582sleep223:37:532
16973991913,3cyclictest188582sleep223:37:532
16973991913,3cyclictest188582sleep223:37:532
16968991911,6cyclictest855-21ls22:48:010
1696899191,16cyclictest2797-21/usr/sbin/munin20:02:490
1696899191,16cyclictest2797-21/usr/sbin/munin20:02:490
94852180,1sleep2351rcuc/220:18:012
1697599181,9cyclictest0-21swapper/323:48:023
1697599181,9cyclictest0-21swapper/323:48:023
1697599181,13cyclictest877-21taskset22:48:013
1697599181,13cyclictest877-21taskset22:48:013
1697599181,13cyclictest877-21taskset22:48:013
1697599181,13cyclictest21005-21chrt22:17:503
1697599181,13cyclictest21005-21chrt22:17:503
1697399181,13cyclictest24847-21chrt22:27:502
1697399181,13cyclictest24847-21chrt22:27:502
16975991711,4cyclictest130772sleep323:22:503
16975991711,4cyclictest130772sleep323:22:503
1697599171,12cyclictest30207-21chrt22:42:423
1697599171,12cyclictest30207-21chrt22:42:423
1697599171,11cyclictest6823-21taskset20:12:523
1697599171,11cyclictest24592-21chrt22:27:433
1697599171,11cyclictest24592-21chrt22:27:433
1697599171,11cyclictest0-21swapper/321:32:583
1697599171,11cyclictest0-21swapper/321:32:583
1697599171,11cyclictest0-21swapper/321:32:583
1697399172,11cyclictest4330-21chrt21:32:502
1697399172,11cyclictest4330-21chrt21:32:502
1697399171,13cyclictest3076-21chrt00:22:512
1697399171,13cyclictest3076-21chrt00:22:512
1697399171,13cyclictest24629-21chrt20:58:012
1697399171,13cyclictest24629-21chrt20:58:012
152382170,3sleep30-21swapper/322:02:423
1697599169,4cyclictest9263-21chrt23:12:493
1697599169,4cyclictest9263-21chrt23:12:493
1697599161,11cyclictest0-21swapper/322:42:503
1697599161,11cyclictest0-21swapper/322:42:503
1697599161,11cyclictest0-21swapper/300:28:033
1697599161,11cyclictest0-21swapper/300:28:033
1697599161,10cyclictest24635-21taskset23:52:533
1697599161,10cyclictest24635-21taskset23:52:533
1697399163,9cyclictest0-21swapper/222:04:012
1697399163,9cyclictest0-21swapper/222:04:012
1697399161,12cyclictest30127-21taskset21:13:002
1697399161,12cyclictest30127-21taskset21:13:002
1697399161,11cyclictest22323-21chrt23:47:502
1697399161,11cyclictest22323-21chrt23:47:502
1697399161,11cyclictest22323-21chrt23:47:502
137222160,2sleep20-21swapper/223:22:572
137222160,2sleep20-21swapper/223:22:572
1697599159,3cyclictest200762sleep320:47:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional