You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 04:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Thu Dec 11, 2025 00:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19170199910899,6cyclictest363-21snmpd23:35:020
1917019997975,2cyclictest0-21swapper/021:40:020
191701999734,4cyclictest131rcu_preempt22:10:010
191701999732,3cyclictest131rcu_preempt19:10:020
1917019997212,8cyclictest1923196-21sshd21:05:230
1917019997212,8cyclictest1923196-21sshd21:05:230
191701999701,66cyclictest0-21swapper/000:00:030
191701999685,4cyclictest131rcu_preempt20:35:020
1917019996811,12cyclictest363-21snmpd19:56:170
191701999672,16cyclictest1927404-21munin-run22:30:010
191701999671,63cyclictest0-21swapper/000:35:010
191701999662,16cyclictest1925547-21sshd21:51:360
191701999652,15cyclictest1934146-21sshd00:39:230
191701999642,14cyclictest1927114-21sshd22:20:230
191701999632,14cyclictest1919845-21sshd20:04:210
191701999631,3cyclictest0-21swapper/020:30:010
191701999631,13cyclictest1933087-21sshd00:18:230
191701999623,15cyclictest1917522-21modprobe19:20:000
191701999622,14cyclictest1929702-21sshd23:14:220
191701999621,16cyclictest1924636-21cat21:35:010
191701999612,18cyclictest1929992-21munin-run23:20:000
191701999612,14cyclictest1919292-21sshd19:50:210
191701999612,13cyclictest1926088-21sshd22:04:230
191701999612,13cyclictest1922180-21sshd20:49:200
191701999611,14cyclictest1926586-21sshd22:12:230
191702399607,7cyclictest23-21ksoftirqd/100:14:591
191701999609,32cyclictest1918541-21modprobe19:40:000
191701999602,13cyclictest1923796-21munin-run21:20:010
191701999602,12cyclictest1919089-21munin-run19:50:010
1917019996013,11cyclictest272-21dbus-daemon23:05:000
191701999601,12cyclictest1928403-21sshd22:46:230
191702799599,5cyclictest131rcu_preempt23:00:012
191701999593,18cyclictest1931033-21sendmail23:40:010
1917019995923,32cyclictest12-21ksoftirqd/019:35:000
1917019995922,34cyclictest12-21ksoftirqd/021:05:020
1917019995922,30cyclictest306-21in:imuxsock21:40:020
191701999592,11cyclictest1929469-21munin-run23:10:010
191701999592,10cyclictest1920350-21cron20:15:010
191701999592,10cyclictest1920350-21cron20:15:000
191701999591,13cyclictest1932359-21munin-run00:05:020
191701999591,12cyclictest1922428-21sshd20:53:220
191701999591,12cyclictest1922428-21sshd20:53:210
191701999582,16cyclictest1-21systemd21:00:000
1917019995817,36cyclictest1191562-1kworker/0:0H22:55:020
1917019995816,37cyclictest1928357-21latency_hist22:45:030
191701999581,16cyclictest1920603-21sshd20:17:210
1917029995716,5cyclictest131rcu_preempt23:40:003
191701999575,16cyclictest1920296-21latency_hist20:10:030
191701999575,10cyclictest1931655-21grep23:50:030
191701999574,15cyclictest1933027-21latency_hist00:15:030
191701999574,14cyclictest1931446-21latency_hist23:45:010
191701999572,10cyclictest1931794-21cron23:55:000
191701999571,12cyclictest1933656-21munin-run00:30:010
191702799565,7cyclictest30-21ksoftirqd/219:25:032
191702799565,7cyclictest30-21ksoftirqd/219:25:022
1917027995613,13cyclictest30-21ksoftirqd/220:40:002
1917027995613,13cyclictest30-21ksoftirqd/220:40:002
191701999562,15cyclictest1927655-21munin-run22:35:010
191701999562,14cyclictest1930529-21systemd-run23:30:000
191701999562,14cyclictest1923505-21systemd-run21:15:010
191701999561,11cyclictest1921922-21modprobe20:42:220
1917027995513,8cyclictest30-21ksoftirqd/200:35:012
191701999551,14cyclictest1-21systemd19:45:000
191702999545,10cyclictest37-21ksoftirqd/322:41:533
1917027995415,9cyclictest30-21ksoftirqd/219:50:012
1917023995435,14cyclictest1-21systemd20:20:001
191701999544,8cyclictest1932585-21cron00:10:000
191701999542,14cyclictest1927888-21sshd22:39:220
191701999541,16cyclictest1925789-21sshd21:55:220
1917027995335,11cyclictest1923229-21modprobe21:10:012
1917027995335,11cyclictest1923229-21modprobe21:10:002
191701999533,7cyclictest1921656-21cron20:40:010
191701999533,7cyclictest1921656-21cron20:40:000
191701999531,3cyclictest0-21swapper/022:56:560
191701999531,13cyclictest363-21snmpd20:21:190
191701999531,13cyclictest363-21snmpd20:21:180
191702999523,10cyclictest37-21ksoftirqd/322:39:593
1917029995215,6cyclictest131rcu_preempt23:05:003
191702799529,6cyclictest131rcu_preempt22:40:002
191702799527,11cyclictest30-21ksoftirqd/223:55:012
1917027995211,5cyclictest131rcu_preempt23:30:022
191701999523,8cyclictest1926858-21cron22:20:010
191701999522,15cyclictest1924300-21unin-run21:30:000
191701999522,12cyclictest1924047-21munin-run21:25:010
1917019995220,27cyclictest12-21ksoftirqd/019:10:030
191702999516,7cyclictest37-21ksoftirqd/322:50:023
191702999516,10cyclictest37-21ksoftirqd/322:15:003
191702999513,8cyclictest37-21ksoftirqd/320:10:013
1917029995131,14cyclictest1-21systemd20:15:013
1917029995131,14cyclictest1-21systemd20:15:003
191702999512,9cyclictest37-21ksoftirqd/300:00:013
1917029995111,6cyclictest131rcu_preempt21:45:013
191702999511,15cyclictest37-21ksoftirqd/323:00:003
1917029995110,6cyclictest131rcu_preempt23:50:033
191702799519,5cyclictest131rcu_preempt22:45:012
191702799518,5cyclictest131rcu_preempt00:06:232
191702799517,8cyclictest30-21ksoftirqd/200:20:022
1917027995136,11cyclictest272-21dbus-daemon20:05:012
1917027995110,6cyclictest131rcu_preempt19:45:012
191701999511,13cyclictest235-21systemd-journal21:47:230
191701999511,13cyclictest1933371-21sshd00:24:030
191702999507,8cyclictest37-21ksoftirqd/322:25:023
191702999507,7cyclictest37-21ksoftirqd/319:25:023
191702999507,7cyclictest37-21ksoftirqd/319:25:023
191702999504,8cyclictest37-21ksoftirqd/300:35:013
1917029995033,14cyclictest1-21systemd21:05:013
191702999503,11cyclictest37-21ksoftirqd/320:40:003
191702999503,11cyclictest37-21ksoftirqd/320:40:003
1917029995011,6cyclictest131rcu_preempt20:20:013
191702799506,4cyclictest131rcu_preempt00:00:012
1917027995033,12cyclictest1-21systemd20:30:012
191701999501,13cyclictest1-21systemd19:25:010
191701999501,13cyclictest1-21systemd19:25:010
191702799499,5cyclictest131rcu_preempt23:05:012
191702799499,5cyclictest131rcu_preempt00:30:022
191702799492,8cyclictest30-21ksoftirqd/221:36:232
191702399498,7cyclictest23-21ksoftirqd/120:00:001
191701999494,14cyclictest235-21systemd-journal23:25:010
191702999487,9cyclictest37-21ksoftirqd/323:45:013
191702999487,10cyclictest37-21ksoftirqd/320:50:003
191702999486,8cyclictest37-21ksoftirqd/323:55:003
191702999486,8cyclictest37-21ksoftirqd/322:20:023
191702999486,7cyclictest37-21ksoftirqd/321:55:013
1917029994833,11cyclictest235-21systemd-journal21:00:003
191702999483,11cyclictest37-21ksoftirqd/319:40:003
191702999481,8cyclictest37-21ksoftirqd/320:00:003
1917029994817,5cyclictest131rcu_preempt00:02:243
1917029994812,6cyclictest131rcu_preempt20:55:023
1917029994812,6cyclictest131rcu_preempt20:55:013
191702799489,5cyclictest131rcu_preempt23:40:012
191702799489,5cyclictest131rcu_preempt20:10:012
191702799489,4cyclictest131rcu_preempt22:15:022
191702799486,7cyclictest30-21ksoftirqd/223:10:002
191702799482,8cyclictest30-21ksoftirqd/223:46:232
191702999479,5cyclictest131rcu_preempt19:10:213
191702999478,6cyclictest131rcu_preempt22:35:003
191702999472,11cyclictest37-21ksoftirqd/321:20:023
191702999471,5cyclictest0-21swapper/322:28:233
191702799477,10cyclictest30-21ksoftirqd/220:50:012
191702799476,9cyclictest30-21ksoftirqd/219:55:002
191702799476,5cyclictest131rcu_preempt20:00:022
191702799475,6cyclictest131rcu_preempt22:55:002
191702799473,8cyclictest30-21ksoftirqd/200:03:512
191702799473,7cyclictest30-21ksoftirqd/221:00:022
1917027994734,7cyclictest30-21ksoftirqd/222:30:032
1917027994734,10cyclictest1-21systemd21:55:012
1917027994710,5cyclictest131rcu_preempt22:05:012
1917023994728,15cyclictest23-21ksoftirqd/100:25:001
191701999473,8cyclictest1918026-21cron19:30:000
191702999467,10cyclictest37-21ksoftirqd/322:50:233
191702999466,9cyclictest37-21ksoftirqd/300:20:023
191702999465,9cyclictest37-21ksoftirqd/319:55:013
1917029994629,13cyclictest37-21ksoftirqd/323:19:593
1917029994610,6cyclictest131rcu_preempt21:40:033
1917029994610,5cyclictest131rcu_preempt21:55:223
191702799469,6cyclictest131rcu_preempt22:00:012
191702799469,5cyclictest131rcu_preempt20:20:032
191702799466,11cyclictest30-21ksoftirqd/220:55:002
191702799466,11cyclictest30-21ksoftirqd/220:55:002
1917027994614,9cyclictest30-21ksoftirqd/223:45:012
1917027994611,6cyclictest131rcu_preempt23:35:012
1917027994611,5cyclictest131rcu_preempt21:20:032
1917023994636,7cyclictest23-21ksoftirqd/100:00:011
1917023994621,9cyclictest131rcu_preempt23:35:031
191702999458,5cyclictest131rcu_preempt00:15:023
191702999457,5cyclictest131rcu_preempt22:06:223
191702999456,9cyclictest37-21ksoftirqd/300:20:233
191702999455,6cyclictest131rcu_preempt23:08:243
191702999454,8cyclictest37-21ksoftirqd/320:25:013
191702999454,8cyclictest37-21ksoftirqd/320:25:003
191702999454,10cyclictest37-21ksoftirqd/319:45:003
1917029994531,11cyclictest235-21systemd-journal21:25:023
191702999452,15cyclictest37-21ksoftirqd/320:25:203
1917029994513,28cyclictest1925337-21unin-run21:50:003
1917029994512,5cyclictest131rcu_preempt21:35:013
1917029994511,5cyclictest131rcu_preempt20:45:033
1917029994510,5cyclictest131rcu_preempt19:30:003
191702799459,6cyclictest131rcu_preempt23:25:022
191702799459,6cyclictest131rcu_preempt22:15:002
191702799457,9cyclictest30-21ksoftirqd/219:20:012
191702799455,8cyclictest30-21ksoftirqd/222:10:012
191702799455,5cyclictest131rcu_preempt19:40:012
1917027994530,11cyclictest235-21systemd-journal22:45:032
191702799452,5cyclictest131rcu_preempt00:40:022
191702799451,9cyclictest1917035-21date19:10:012
1917027994512,8cyclictest131rcu_preempt21:30:012
1917027994511,6cyclictest131rcu_preempt22:30:002
191702799451,10cyclictest30-21ksoftirqd/221:25:022
1917027994510,5cyclictest131rcu_preempt00:15:022
1917023994534,8cyclictest23-21ksoftirqd/122:15:011
1917023994529,11cyclictest235-21systemd-journal19:15:021
191702999449,5cyclictest131rcu_preempt19:50:023
191702999448,5cyclictest131rcu_preempt00:40:023
1917029994412,5cyclictest131rcu_preempt23:30:003
1917029994411,5cyclictest131rcu_preempt23:15:013
191702799449,5cyclictest131rcu_preempt20:25:012
191702799449,5cyclictest131rcu_preempt20:25:012
191702799448,6cyclictest131rcu_preempt23:16:592
191702799448,5cyclictest131rcu_preempt22:25:022
191702799446,5cyclictest131rcu_preempt00:25:012
191702799445,5cyclictest30-21ksoftirqd/219:35:012
1917027994435,6cyclictest30-21ksoftirqd/221:50:002
1917027994411,5cyclictest131rcu_preempt20:15:022
1917027994411,5cyclictest131rcu_preempt20:15:022
1917027994410,5cyclictest131rcu_preempt21:35:012
1917023994436,5cyclictest23-21ksoftirqd/100:33:251
191702999434,5cyclictest131rcu_preempt00:30:003
1917029994314,8cyclictest131rcu_preempt19:16:043
1917029994310,5cyclictest131rcu_preempt21:15:033
191702799439,6cyclictest131rcu_preempt21:05:012
191702799435,7cyclictest30-21ksoftirqd/219:15:012
191702799434,7cyclictest30-21ksoftirqd/221:15:012
191702799434,6cyclictest131rcu_preempt20:45:002
191702999428,4cyclictest131rcu_preempt23:21:473
191702999427,5cyclictest131rcu_preempt20:04:213
191702999426,6cyclictest131rcu_preempt00:10:013
191702999423,10cyclictest37-21ksoftirqd/319:35:023
191702799426,6cyclictest131rcu_preempt19:30:002
191702799423,5cyclictest30-21ksoftirqd/221:45:012
1917023994235,5cyclictest23-21ksoftirqd/122:50:011
1917023994232,7cyclictest23-21ksoftirqd/120:55:021
1917023994228,10cyclictest1-21systemd00:30:001
191702399422,4cyclictest131rcu_preempt00:05:001
1917029994122,12cyclictest0-21swapper/321:10:003
1917029994122,12cyclictest0-21swapper/321:10:003
1917029994111,5cyclictest131rcu_preempt19:10:033
191702799414,7cyclictest30-21ksoftirqd/223:13:232
1917023994133,5cyclictest23-21ksoftirqd/120:25:011
1917023994133,5cyclictest23-21ksoftirqd/120:25:001
1917023994112,22cyclictest23-21ksoftirqd/119:45:381
191702799402,7cyclictest30-21ksoftirqd/220:35:022
191702399406,5cyclictest131rcu_preempt21:50:031
1917023994028,8cyclictest23-21ksoftirqd/122:05:011
1917023994024,10cyclictest23-21ksoftirqd/121:55:001
191702399401,7cyclictest0-21swapper/122:31:231
191702399401,6cyclictest0-21swapper/122:16:411
191702399401,5cyclictest131rcu_preempt22:30:011
1917023994012,5cyclictest131rcu_preempt23:10:011
1917023994010,5cyclictest131rcu_preempt21:21:241
191702999396,7cyclictest37-21ksoftirqd/320:31:243
1917029993931,6cyclictest37-21ksoftirqd/321:30:013
191702399398,5cyclictest131rcu_preempt20:15:001
191702399398,5cyclictest131rcu_preempt20:15:001
191702399393,6cyclictest23-21ksoftirqd/120:46:211
191702399392,5cyclictest131rcu_preempt21:15:011
1917023993922,13cyclictest235-21systemd-journal23:25:031
1917023993922,11cyclictest235-21systemd-journal21:40:001
1917023993921,12cyclictest235-21systemd-journal22:09:591
1917023993917,18cyclictest221rcuc/120:41:211
191702399391,6cyclictest0-21swapper/120:50:221
191702399391,6cyclictest0-21swapper/120:50:211
1917029993822,13cyclictest37-21ksoftirqd/323:35:023
191702399388,5cyclictest131rcu_preempt00:20:011
191702399384,5cyclictest131rcu_preempt23:55:021
1917023993831,5cyclictest23-21ksoftirqd/120:32:051
1917023993826,8cyclictest235-21systemd-journal21:08:231
1917023993826,8cyclictest235-21systemd-journal21:08:221
191702399381,7cyclictest0-21swapper/119:35:231
1917023993817,10cyclictest23-21ksoftirqd/119:45:011
1917023993816,10cyclictest23-21ksoftirqd/122:40:001
1917023993815,14cyclictest23-21ksoftirqd/122:56:381
1917023993813,21cyclictest221rcuc/119:15:011
191702999371,13cyclictest0-21swapper/322:00:053
191702399372,5cyclictest131rcu_preempt20:26:201
191702399371,8cyclictest23-21ksoftirqd/123:15:001
1917023993718,14cyclictest1-21systemd23:20:011
191702399367,8cyclictest23-21ksoftirqd/100:39:571
191702399365,4cyclictest131rcu_preempt22:50:231
191702399364,9cyclictest23-21ksoftirqd/119:27:201
1917023993627,7cyclictest23-21ksoftirqd/119:10:011
1917023993627,6cyclictest23-21ksoftirqd/120:10:001
1917023993615,17cyclictest221rcuc/120:40:021
1917023993615,17cyclictest221rcuc/120:40:011
1917023993613,15cyclictest23-21ksoftirqd/121:57:261
1917023993611,17cyclictest23-21ksoftirqd/119:34:201
191702399356,5cyclictest131rcu_preempt21:31:301
191702399354,5cyclictest131rcu_preempt19:21:221
191702399354,5cyclictest131rcu_preempt19:21:211
1917023993526,6cyclictest23-21ksoftirqd/121:17:001
1917023993524,7cyclictest1928144-21date22:40:021
191702399351,9cyclictest1-21systemd19:55:011
1917023993516,14cyclictest272-21dbus-daemon21:30:001
1917023993511,16cyclictest23-21ksoftirqd/120:01:271
191702399348,14cyclictest23-21ksoftirqd/123:05:011
191702399347,5cyclictest131rcu_preempt23:46:161
191702399346,5cyclictest131rcu_preempt21:40:221
191702399346,5cyclictest131rcu_preempt00:06:241
1917023993427,5cyclictest23-21ksoftirqd/122:25:021
1917023993425,6cyclictest23-21ksoftirqd/123:40:011
191702399331,8cyclictest0-21swapper/121:02:021
191702399322,4cyclictest131rcu_preempt23:42:531
191702399322,4cyclictest131rcu_preempt23:20:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional