You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 10:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Sun Dec 07, 2025 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
142193299941,61cyclictest1427955-21cat21:05:010
1421932997771,3cyclictest0-21swapper/022:25:010
142193799711,46cyclictest1436962-40gzip00:00:042
1421934996910,11cyclictest23-21ksoftirqd/123:20:021
142193299681,6cyclictest1437009-21sed00:00:020
142193299671,2cyclictest0-21swapper/020:24:590
142193299662,33cyclictest1430937-21sshd22:01:420
142193299661,38cyclictest363-21snmpd22:37:230
142193299652,33cyclictest1424729-21munin-run20:05:010
142193299651,59cyclictest1426061-21latency_hist20:30:020
1421932996426,34cyclictest12-21ksoftirqd/023:15:020
142193299641,58cyclictest1437273-21latency_hist00:05:010
1421932996326,31cyclictest306-21in:imuxsock20:39:590
1421932996217,40cyclictest16850irq/134-800000021:51:430
142193299621,2cyclictest0-21swapper/020:15:020
1421934996115,9cyclictest23-21ksoftirqd/119:10:011
142193299612,54cyclictest1428065-21sshd21:06:430
142193299611,56cyclictest16950irq/224-800000020:41:340
142193299603,51cyclictest1424499-21grep20:00:010
1421934995916,11cyclictest23-21ksoftirqd/121:10:011
1421932995950,2cyclictest0-21swapper/023:00:020
1421934995813,8cyclictest23-21ksoftirqd/121:25:001
142193299583,50cyclictest1-21systemd19:55:010
142193299583,49cyclictest1-21systemd19:30:010
142193299572,50cyclictest1429637-21sshd21:39:430
142193299571,5cyclictest0-21swapper/020:20:010
142193299571,51cyclictest1429165-21unin-run21:30:000
142193299571,2cyclictest0-21swapper/022:10:020
142193799561,22cyclictest1423359-21cat19:35:032
1421934995637,14cyclictest1-21systemd19:45:011
142193299564,47cyclictest1432521-21munin-run22:35:000
142193299563,48cyclictest1434860-21munin-run23:20:010
142193299562,50cyclictest1435819-21cat23:35:030
142193299561,50cyclictest1438272-21sh00:25:010
142193299561,50cyclictest1438272-21sh00:25:010
142193299552,48cyclictest1437461-21cron00:10:000
1421932995510,37cyclictest0-21swapper/019:45:000
1421934995414,8cyclictest23-21ksoftirqd/121:15:001
142193299542,47cyclictest1438799-21unin-run00:35:010
142193299542,47cyclictest1438799-21unin-run00:35:010
142193299542,46cyclictest272-21dbus-daemon19:20:000
142193299542,46cyclictest1433285-21sshd22:48:440
142193299541,47cyclictest48-21kcompactd022:16:290
1421942995335,13cyclictest1-21systemd23:15:003
1421934995315,7cyclictest0-21swapper/121:56:421
142193299532,47cyclictest1424962-21sshd20:09:430
142193299532,46cyclictest1435393-21munin-run23:30:010
142193299532,45cyclictest1-21systemd21:35:010
142193299531,47cyclictest1426291-21munin-run20:35:020
1421932995311,38cyclictest1439194-21sed00:40:020
142193799522,45cyclictest1-21systemd23:50:012
142193299522,46cyclictest1423425-21munin-run19:40:010
142193299522,45cyclictest1432275-21true22:30:010
142193299521,4cyclictest0-21swapper/023:40:010
142193299521,47cyclictest1437971-21sshd00:19:450
142193299521,47cyclictest1436286-21latency_hist23:45:020
1421942995128,16cyclictest272-21dbus-daemon00:00:013
1421937995128,19cyclictest1-21systemd23:05:012
142193299512,45cyclictest1436432-21munin-run23:50:000
142193299512,44cyclictest1434344-21true23:10:010
142193299512,44cyclictest1434344-21true23:10:000
142193299511,46cyclictest1427282-21sshd20:51:430
142193299511,46cyclictest1423912-21sshd19:45:430
142193299511,45cyclictest1437730-21systemd-run00:15:000
142193299511,45cyclictest1430352-21latency_hist21:50:010
142193299511,12cyclictest1436675-21sh23:55:000
1421937995034,12cyclictest1-21systemd00:35:012
1421937995034,12cyclictest1-21systemd00:35:012
1421934995012,8cyclictest0-21swapper/121:48:431
142193299502,44cyclictest1430700-21munin-run22:00:010
142193299502,44cyclictest1429935-21munin-run21:45:010
142193299502,44cyclictest1429935-21munin-run21:45:010
142193299502,44cyclictest1427061-21munin-run20:50:010
1421937994933,13cyclictest1-21systemd20:05:002
142193499498,9cyclictest23-21ksoftirqd/120:25:021
142193499498,10cyclictest0-21swapper/121:03:431
142193299492,5cyclictest1435109-21sshd23:23:450
142193299492,42cyclictest1433850-21munin-run23:00:010
142193299491,44cyclictest1433025-21sshd22:41:450
142193299491,43cyclictest1433525-21sshd22:51:450
142193299491,2cyclictest0-21swapper/000:30:020
1421932994912,32cyclictest1428620-21cron21:20:000
142193299491,14cyclictest308-21rs:main0
1421942994830,14cyclictest235-21systemd-journal20:35:013
1421937994829,14cyclictest1-21systemd19:15:012
1421937994829,14cyclictest1-21systemd19:15:002
142193499485,8cyclictest23-21ksoftirqd/122:05:001
1421934994830,13cyclictest235-21systemd-journal20:40:011
1421934994817,28cyclictest1423457-21kworker/1:220:20:011
142193299483,40cyclictest1428901-21munin-run21:25:000
142193299481,43cyclictest363-21snmpd19:10:100
142193299481,43cyclictest363-21snmpd19:10:100
142193299481,17cyclictest1422817-21date19:25:020
142193799472,3cyclictest131rcu_preempt22:05:002
1421934994729,14cyclictest235-21systemd-journal21:39:591
1421934994712,6cyclictest0-21swapper/122:54:451
1421934994711,7cyclictest0-21swapper/122:10:001
1421934994710,7cyclictest0-21swapper/100:30:011
142193299472,40cyclictest1428338-21sshd21:13:440
1421932994721,23cyclictest1421860-21latency_hist19:10:020
142193299471,42cyclictest1431451-21sshd22:13:430
142193299471,42cyclictest1431451-21sshd22:13:430
142193299471,41cyclictest1-21systemd19:30:430
1421942994629,13cyclictest37-21ksoftirqd/323:40:013
1421942994623,14cyclictest0-21swapper/323:50:003
1421937994635,6cyclictest306-21in:imuxsock21:40:002
1421937994631,11cyclictest1-21systemd20:20:022
1421942994528,13cyclictest1-21systemd20:10:013
142193799454,4cyclictest131rcu_preempt21:50:002
1421937994533,9cyclictest1428065-21sshd21:06:422
1421937994530,12cyclictest1-21systemd23:10:012
1421937994530,12cyclictest1-21systemd23:10:012
1421937994526,15cyclictest1-21systemd00:10:012
1421934994539,3cyclictest0-21swapper/122:25:021
1421934994529,12cyclictest272-21dbus-daemon20:45:011
1421934994512,5cyclictest0-21swapper/122:41:591
1421942994432,7cyclictest1432519-21munin-plugin-st22:35:003
1421942994431,10cyclictest37-21ksoftirqd/322:40:013
142194299441,6cyclictest131rcu_preempt20:39:593
1421937994435,6cyclictest1431738-21sendmail22:20:002
1421937994430,11cyclictest30-21ksoftirqd/220:55:012
1421937994430,11cyclictest1438000-21systemctl00:19:592
142193799442,33cyclictest291rcuc/200:25:022
142193799442,33cyclictest291rcuc/200:25:022
142193499448,6cyclictest0-21swapper/120:15:011
1421934994428,10cyclictest306-21in:imuxsock19:12:431
1421934994428,10cyclictest306-21in:imuxsock19:12:421
1421934994421,17cyclictest235-21systemd-journal00:10:001
1421942994330,7cyclictest37-21ksoftirqd/319:45:003
1421942994330,6cyclictest306-21in:imuxsock19:55:013
1421942994327,10cyclictest235-21systemd-journal00:35:013
1421942994327,10cyclictest235-21systemd-journal00:35:013
1421942994324,13cyclictest37-21ksoftirqd/319:40:003
1421937994327,12cyclictest272-21dbus-daemon21:25:012
142193499436,5cyclictest23-21ksoftirqd/100:00:101
142193499434,6cyclictest23-21ksoftirqd/121:55:011
142193499432,7cyclictest23-21ksoftirqd/119:25:011
1421942994229,9cyclictest235-21systemd-journal21:30:033
1421942994227,11cyclictest235-21systemd-journal23:45:003
1421937994227,12cyclictest272-21dbus-daemon22:40:012
1421934994233,5cyclictest1436941-21sendmail00:00:001
1421934994225,11cyclictest235-21systemd-journal23:40:001
1421942994131,7cyclictest37-21ksoftirqd/300:10:013
1421942994131,7cyclictest1430953-21cron22:04:593
1421942994123,12cyclictest235-21systemd-journal22:20:003
1421942994122,13cyclictest272-21dbus-daemon23:00:003
142193799418,6cyclictest131rcu_preempt00:02:152
142193799416,17cyclictest0-21swapper/223:00:022
1421937994127,10cyclictest1-21systemd00:30:002
1421937994126,11cyclictest1426551-21tr20:40:002
1421937994126,11cyclictest1-21systemd19:25:002
1421937994126,10cyclictest30-21ksoftirqd/223:55:012
1421937994124,12cyclictest30-21ksoftirqd/221:19:592
1421934994129,9cyclictest1-21systemd20:55:011
1421934994127,11cyclictest235-21systemd-journal21:00:001
1421934994125,12cyclictest1437823-21latency_hist00:15:021
1421934994118,17cyclictest235-21systemd-journal22:35:001
1421942994032,5cyclictest0-21swapper/319:10:013
1421942994027,9cyclictest37-21ksoftirqd/321:29:593
1421942994025,11cyclictest235-21systemd-journal22:00:023
1421942994023,13cyclictest272-21dbus-daemon20:55:013
142194299401,31cyclictest1431693-21kworker/u8:023:30:023
142193799403,3cyclictest131rcu_preempt19:45:012
1421937994029,7cyclictest1430424-21cron21:54:592
1421937994027,10cyclictest272-21dbus-daemon22:30:002
142193799401,3cyclictest131rcu_preempt22:00:012
142193499409,4cyclictest0-21swapper/120:30:011
142193499407,7cyclictest0-21swapper/123:09:451
142193499407,7cyclictest0-21swapper/123:09:451
1421934994013,6cyclictest0-21swapper/120:46:441
142194299394,5cyclictest131rcu_preempt20:15:023
1421942993927,9cyclictest37-21ksoftirqd/300:00:523
1421942993922,11cyclictest272-21dbus-daemon20:45:013
1421942993919,14cyclictest272-21dbus-daemon21:25:013
1421937993930,5cyclictest306-21in:imuxsock22:33:062
1421937993924,11cyclictest272-21dbus-daemon19:20:002
142193499397,7cyclictest23-21ksoftirqd/100:31:451
142193499397,7cyclictest23-21ksoftirqd/100:31:441
1421934993926,9cyclictest1431451-21sshd22:13:431
1421934993926,9cyclictest1431451-21sshd22:13:431
1421934993926,10cyclictest1-21systemd19:30:011
142194299388,6cyclictest131rcu_preempt20:20:013
1421942993823,11cyclictest1-21systemd22:50:003
1421942993822,12cyclictest235-21systemd-journal21:13:443
1421942993822,11cyclictest235-21systemd-journal22:30:013
1421942993818,15cyclictest272-21dbus-daemon20:50:013
1421942993810,6cyclictest131rcu_preempt23:20:003
1421937993830,5cyclictest1435891-21latency_hist23:40:002
1421937993827,9cyclictest30-21ksoftirqd/223:25:012
1421937993827,8cyclictest1428427-21sed21:15:022
1421937993825,9cyclictest30-21ksoftirqd/200:40:022
1421937993825,10cyclictest235-21systemd-journal22:07:432
1421937993824,11cyclictest1424978-21latency_hist20:10:022
1421937993824,10cyclictest272-21dbus-daemon23:30:012
1421937993823,12cyclictest1-21systemd21:00:012
1421937993819,15cyclictest1427839-21modprobe21:05:002
142193499386,7cyclictest23-21ksoftirqd/123:23:151
1421934993826,8cyclictest1434569-21sshd23:13:451
1421934993824,8cyclictest1423427-21systemctl19:40:001
1421934993823,11cyclictest23-21ksoftirqd/123:00:011
1421934993823,11cyclictest1435806-21wc23:35:031
142193499381,7cyclictest0-21swapper/121:32:481
1421942993729,6cyclictest37-21ksoftirqd/320:00:013
1421942993727,7cyclictest37-21ksoftirqd/319:20:003
1421942993725,7cyclictest1430188-21munin-run21:49:593
1421942993725,10cyclictest37-21ksoftirqd/321:45:013
1421942993725,10cyclictest37-21ksoftirqd/321:45:013
1421942993722,11cyclictest272-21dbus-daemon19:15:013
1421942993722,11cyclictest272-21dbus-daemon19:15:013
1421942993719,13cyclictest272-21dbus-daemon20:25:003
1421942993711,5cyclictest131rcu_preempt20:27:433
1421937993729,6cyclictest30-21ksoftirqd/220:50:022
1421937993727,8cyclictest30-21ksoftirqd/221:35:022
1421937993724,10cyclictest1426889-21cat20:45:012
1421937993720,13cyclictest1-21systemd20:00:012
142193499379,9cyclictest0-21swapper/119:50:321
142193499376,7cyclictest0-21swapper/122:20:001
1421934993725,9cyclictest23-21ksoftirqd/120:10:001
1421934993724,10cyclictest235-21systemd-journal00:36:461
1421934993723,9cyclictest23-21ksoftirqd/123:30:021
1421934993723,10cyclictest1-21systemd21:20:001
1421934993710,5cyclictest0-21swapper/121:26:181
142194299369,7cyclictest131rcu_preempt21:00:003
142194299362,8cyclictest1436671-21/usr/sbin/munin23:55:013
1421942993625,9cyclictest37-21ksoftirqd/300:30:023
1421942993625,8cyclictest37-21ksoftirqd/321:35:043
1421942993623,10cyclictest37-21ksoftirqd/323:35:013
1421942993623,10cyclictest37-21ksoftirqd/321:16:423
1421942993623,10cyclictest37-21ksoftirqd/320:05:023
1421942993620,12cyclictest272-21dbus-daemon22:55:003
1421942993611,6cyclictest131rcu_preempt00:38:293
1421937993619,13cyclictest1433304-21munin-plugin-st22:50:012
142193499363,8cyclictest23-21ksoftirqd/100:20:451
142193499363,8cyclictest23-21ksoftirqd/100:20:451
1421934993626,8cyclictest23-21ksoftirqd/122:50:031
1421934993625,8cyclictest23-21ksoftirqd/121:45:011
1421934993625,8cyclictest23-21ksoftirqd/121:45:011
1421934993623,9cyclictest235-21systemd-journal19:16:431
1421934993623,10cyclictest23-21ksoftirqd/122:30:021
1421934993622,9cyclictest272-21dbus-daemon20:05:011
142193499361,6cyclictest0-21swapper/100:16:561
142194299353,6cyclictest131rcu_preempt19:50:023
1421942993525,7cyclictest37-21ksoftirqd/322:09:443
1421942993523,7cyclictest37-21ksoftirqd/322:25:003
1421942993522,10cyclictest37-21ksoftirqd/321:05:013
142193799359,6cyclictest131rcu_preempt22:10:442
142193799359,6cyclictest131rcu_preempt22:10:442
1421937993526,5cyclictest306-21in:imuxsock20:35:012
142193799352,5cyclictest131rcu_preempt19:55:022
142193799352,5cyclictest0-21swapper/223:20:022
1421937993524,7cyclictest30-21ksoftirqd/220:15:022
1421937993521,9cyclictest1425483-21cron20:20:032
1421937993521,11cyclictest272-21dbus-daemon19:50:002
1421937993520,10cyclictest272-21dbus-daemon21:30:022
1421937993516,14cyclictest0-21swapper/219:40:012
142193499356,5cyclictest131rcu_preempt19:58:431
1421934993527,6cyclictest23-21ksoftirqd/119:35:021
1421942993425,6cyclictest37-21ksoftirqd/300:25:013
1421942993425,6cyclictest37-21ksoftirqd/300:25:013
1421942993424,7cyclictest1423247-21sed19:35:013
142194299342,24cyclictest1431473-21grep22:15:013
142194299342,24cyclictest1431473-21grep22:15:013
1421942993420,10cyclictest272-21dbus-daemon19:30:013
1421937993423,8cyclictest1426203-21wc20:30:022
1421937993419,11cyclictest281-21systemd-logind22:55:002
1421937993417,11cyclictest272-21dbus-daemon22:25:012
1421934993414,16cyclictest1436208-21cat23:45:011
142194299336,6cyclictest131rcu_preempt00:20:003
1421942993326,4cyclictest412-21sshd19:21:443
1421942993317,12cyclictest272-21dbus-daemon00:15:003
142194299331,5cyclictest131rcu_preempt21:10:023
142193799338,19cyclictest1429926-21modprobe21:45:012
142193799338,19cyclictest1429926-21modprobe21:45:012
1421937993322,9cyclictest30-21ksoftirqd/219:26:182
1421934993324,6cyclictest1424084-21latency_hist19:50:031
1421934993324,5cyclictest1434284-21latency_hist23:05:021
1421934993320,10cyclictest23-21ksoftirqd/123:51:451
142193499331,8cyclictest0-21swapper/120:33:441
1421934993311,18cyclictest1436418-21munin-plugin-st23:50:011
1421942993225,4cyclictest1434068-21sshd23:04:453
1421937993215,12cyclictest0-21swapper/223:40:022
1421934993221,9cyclictest23-21ksoftirqd/122:40:011
1421942993123,5cyclictest341irq_work/322:45:023
1421942993123,5cyclictest1431482-21kworker/3:023:05:443
1421942993123,5cyclictest1431482-21kworker/3:023:05:433
1421942993122,6cyclictest37-21ksoftirqd/321:55:023
142193799312,3cyclictest131rcu_preempt23:13:442
1421937993116,10cyclictest235-21systemd-journal00:15:012
1421942993017,10cyclictest1435112-21sshd23:24:453
1421937993020,7cyclictest30-21ksoftirqd/223:32:292
1421937993013,13cyclictest272-21dbus-daemon22:45:012
1421937992821,5cyclictest30-21ksoftirqd/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional