You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 08:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Fri Dec 12, 2025 00:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2041185999383,7cyclictest0-21swapper/023:25:010
2041185998076,2cyclictest0-21swapper/000:35:020
204118599731,69cyclictest0-21swapper/023:10:020
2041185996817,19cyclictest2044548-21date20:15:010
2041195996555,8cyclictest37-21ksoftirqd/323:00:023
2041192996524,7cyclictest2052959-21latency_hist22:55:012
204118599641,30cyclictest2042822-21latency_hist19:40:030
204118599641,30cyclictest2042822-21latency_hist19:40:020
2041192996217,15cyclictest235-21systemd-journal00:23:322
2041192996034,21cyclictest30-21ksoftirqd/220:25:032
204118599591,17cyclictest2053548-21cut23:05:030
204118599591,17cyclictest2053548-21cut23:05:020
2041192995826,7cyclictest30-21ksoftirqd/221:35:032
2041192995826,7cyclictest30-21ksoftirqd/221:35:032
2041192995824,10cyclictest30-21ksoftirqd/219:40:012
2041192995824,10cyclictest30-21ksoftirqd/219:40:002
204118599581,2cyclictest0-21swapper/021:00:010
204119099578,7cyclictest131rcu_preempt20:39:591
204118599572,18cyclictest2049020-21date21:40:020
204119299563,19cyclictest2041588-21kworker/u8:019:20:022
2041185995438,12cyclictest235-21systemd-journal21:30:010
2041185995416,9cyclictest12-21ksoftirqd/023:50:010
2041192995334,14cyclictest272-21dbus-daemon19:45:002
204119099538,6cyclictest131rcu_preempt00:00:001
2041190995336,13cyclictest1-21systemd23:10:001
204119599523,23cyclictest2050945-21kworker/u8:122:20:033
2041190995235,13cyclictest235-21systemd-journal20:03:431
2041190995229,11cyclictest2052028-21cron22:40:001
204119599512,5cyclictest131rcu_preempt00:35:013
204119599512,5cyclictest131rcu_preempt00:35:013
204118599513,7cyclictest2056244-21munin-run00:00:010
2041190995015,6cyclictest131rcu_preempt23:19:591
2041195994937,6cyclictest306-21in:imuxsock00:20:013
2041190994932,13cyclictest235-21systemd-journal23:32:431
2041185994933,11cyclictest272-21dbus-daemon19:45:000
204118599491,44cyclictest2043453-21munin-plugin-st19:55:000
204118599491,44cyclictest2043453-21munin-plugin-st19:55:000
204118599491,14cyclictest1-21systemd00:10:010
204118599491,14cyclictest1-21systemd00:10:000
2041195994831,12cyclictest1-21systemd23:35:013
2041195994826,16cyclictest2043180-21kworker/u8:320:00:003
2041195994824,19cyclictest272-21dbus-daemon23:55:013
2041192994830,14cyclictest30-21ksoftirqd/223:20:022
2041190994831,12cyclictest2047866-21cron21:20:001
2041185994832,12cyclictest1-21systemd22:40:000
204118599480,13cyclictest1-21systemd23:40:000
2041195994735,8cyclictest235-21systemd-journal19:40:013
2041195994735,8cyclictest235-21systemd-journal19:40:003
2041195994729,13cyclictest272-21dbus-daemon00:00:013
2041190994734,7cyclictest306-21in:imuxsock19:15:001
2041185994729,13cyclictest1-21systemd22:10:010
2041195994629,13cyclictest1-21systemd19:20:003
2041192994634,9cyclictest30-21ksoftirqd/200:40:002
2041192994633,9cyclictest306-21in:imuxsock19:45:022
204119299463,35cyclictest2053082-21kworker/u8:223:05:032
204119299461,41cyclictest30-21ksoftirqd/220:45:012
204119099461,11cyclictest2050222-21cron22:05:011
204119099461,11cyclictest2050222-21cron22:05:011
2041185994628,13cyclictest1-21systemd22:20:010
2041185994626,14cyclictest235-21systemd-journal20:30:010
204118599461,41cyclictest1-21systemd20:15:430
2041195994530,12cyclictest2054181-21tr23:20:003
2041192994531,11cyclictest235-21systemd-journal20:30:002
2041192994530,10cyclictest272-21dbus-daemon21:00:002
2041190994532,10cyclictest1-21systemd00:30:011
2041190994525,14cyclictest1-21systemd00:20:011
2041190994518,22cyclictest221rcuc/123:15:011
2041190994511,6cyclictest131rcu_preempt20:50:011
2041185994531,9cyclictest2051522-21munin-plugin-st22:30:000
2041185994530,10cyclictest306-21in:imuxsock00:35:010
2041185994530,10cyclictest306-21in:imuxsock00:35:010
2041185994526,14cyclictest2056502-21sshd00:03:440
2041185994524,14cyclictest272-21dbus-daemon19:15:020
2041185994523,17cyclictest1-21systemd22:15:000
204118599450,42cyclictest0-21swapper/000:25:010
2041192994428,11cyclictest235-21systemd-journal20:20:002
204119099448,6cyclictest131rcu_preempt19:55:011
204119099448,6cyclictest131rcu_preempt19:55:001
2041190994431,10cyclictest272-21dbus-daemon23:25:021
2041190994424,14cyclictest272-21dbus-daemon21:50:021
2041190994424,14cyclictest272-21dbus-daemon21:50:011
2041185994438,2cyclictest0-21swapper/022:30:030
2041195994326,13cyclictest1-21systemd21:55:013
2041192994330,9cyclictest2056224-21cron00:00:012
2041192994330,9cyclictest1-21systemd21:05:002
2041192994328,10cyclictest306-21in:imuxsock21:20:002
204119099433,7cyclictest131rcu_preempt22:59:591
2041190994327,12cyclictest2049956-21systemctl22:00:001
2041190994320,8cyclictest23-21ksoftirqd/123:44:451
2041190994318,19cyclictest2050999-21run-parts22:20:001
2041190994311,5cyclictest131rcu_preempt00:02:451
2041190994310,6cyclictest131rcu_preempt21:35:011
2041190994310,6cyclictest131rcu_preempt21:35:001
2041185994331,9cyclictest12-21ksoftirqd/019:30:000
2041185994329,11cyclictest12-21ksoftirqd/000:20:010
204118599432,14cyclictest2046421-21ls20:50:020
2041195994225,13cyclictest235-21systemd-journal22:05:023
2041195994225,13cyclictest235-21systemd-journal22:05:013
2041195994224,14cyclictest235-21systemd-journal21:05:013
2041195994224,13cyclictest1-21systemd19:35:003
2041192994232,8cyclictest30-21ksoftirqd/220:15:002
204119099424,5cyclictest131rcu_preempt21:15:021
2041190994228,10cyclictest235-21systemd-journal21:10:001
2041190994217,7cyclictest2043237-21cat19:50:011
2041185994230,8cyclictest306-21in:imuxsock22:45:010
2041185994225,13cyclictest2055967-21sshd23:54:450
2041195994131,6cyclictest2058340-21sendmail00:39:593
2041195994128,9cyclictest37-21ksoftirqd/300:05:013
2041195994127,9cyclictest272-21dbus-daemon20:40:013
2041195994126,11cyclictest235-21systemd-journal20:10:023
2041195994126,11cyclictest235-21systemd-journal20:10:013
2041195994124,14cyclictest1-21systemd21:20:023
2041192994130,6cyclictest306-21in:imuxsock20:10:012
2041192994130,6cyclictest306-21in:imuxsock20:10:002
2041192994129,10cyclictest30-21ksoftirqd/200:35:032
2041192994128,10cyclictest235-21systemd-journal00:14:452
2041192994113,6cyclictest131rcu_preempt22:05:012
2041192994113,6cyclictest131rcu_preempt22:05:002
204119099418,10cyclictest23-21ksoftirqd/123:36:451
204119099418,10cyclictest131rcu_preempt19:30:011
204119099417,6cyclictest131rcu_preempt21:40:001
2041190994129,8cyclictest23-21ksoftirqd/120:05:031
2041190994129,8cyclictest23-21ksoftirqd/120:05:021
2041190994128,10cyclictest272-21dbus-daemon00:15:001
2041190994127,9cyclictest306-21in:imuxsock20:40:011
2041190994127,11cyclictest272-21dbus-daemon20:25:511
2041185994121,14cyclictest235-21systemd-journal00:29:590
204118599411,34cyclictest272-21dbus-daemon20:25:000
204119599403,4cyclictest131rcu_preempt19:44:593
2041195994029,8cyclictest37-21ksoftirqd/321:55:023
204119599402,33cyclictest37-21ksoftirqd/320:59:593
2041195994023,11cyclictest0-21swapper/322:30:013
2041195994012,23cyclictest1-21systemd23:05:013
2041195994012,23cyclictest1-21systemd23:05:003
204119299407,3cyclictest131rcu_preempt19:30:012
2041192994021,14cyclictest272-21dbus-daemon20:05:012
204119099408,6cyclictest131rcu_preempt20:20:001
204119099404,23cyclictest2046812-21modprobe21:00:001
2041190994031,6cyclictest221rcuc/122:40:461
2041185994023,12cyclictest2047860-21sshd21:18:440
204118599401,2cyclictest0-21swapper/019:10:010
2041195993927,9cyclictest37-21ksoftirqd/323:30:013
2041195993924,11cyclictest235-21systemd-journal21:35:023
2041195993924,11cyclictest235-21systemd-journal21:35:013
2041195993923,10cyclictest306-21in:imuxsock19:22:443
2041195993919,12cyclictest272-21dbus-daemon21:10:003
2041195993918,14cyclictest272-21dbus-daemon22:45:013
2041192993927,9cyclictest30-21ksoftirqd/220:55:022
2041192993926,9cyclictest235-21systemd-journal22:27:432
2041192993926,9cyclictest235-21systemd-journal21:50:012
2041192993926,9cyclictest235-21systemd-journal21:50:002
204119299392,17cyclictest2054925-21kworker/u8:123:45:012
2041190993928,9cyclictest23-21ksoftirqd/123:55:011
2041190993927,9cyclictest2052593-21sshd22:49:431
2041190993927,8cyclictest2041677-21systemd-run19:20:001
2041190993910,7cyclictest23-21ksoftirqd/121:55:021
2041190993910,5cyclictest131rcu_preempt19:40:011
2041190993910,5cyclictest131rcu_preempt19:40:001
2041185993926,9cyclictest12-21ksoftirqd/023:45:010
2041185993926,10cyclictest363-21snmpd19:55:200
2041185993926,10cyclictest0-21swapper/023:30:020
2041185993920,14cyclictest272-21dbus-daemon19:35:000
2041185993918,16cyclictest272-21dbus-daemon22:00:010
204118599390,36cyclictest2053883-21sshd23:14:440
2041195993818,16cyclictest272-21dbus-daemon00:15:013
2041192993828,6cyclictest2052016-21cron22:40:002
2041192993823,12cyclictest30-21ksoftirqd/200:00:052
2041192993823,12cyclictest2055886-21sed23:50:022
204119299381,33cyclictest30-21ksoftirqd/222:45:012
204119099385,6cyclictest131rcu_preempt21:25:001
2041190993828,6cyclictest2054691-21munin-plugin-st23:30:011
2041190993827,8cyclictest23-21ksoftirqd/123:50:011
2041190993825,10cyclictest23-21ksoftirqd/122:05:431
2041190993825,10cyclictest23-21ksoftirqd/121:04:441
2041190993823,12cyclictest235-21systemd-journal00:24:591
2041190993818,15cyclictest235-21systemd-journal20:25:011
204118599384,29cyclictest235-21systemd-journal19:20:000
204118599383,5cyclictest2051382-21cat22:25:010
2041185993829,5cyclictest2048157-21munin-plugin-st21:24:590
2041185993827,8cyclictest12-21ksoftirqd/021:05:010
2041185993826,8cyclictest363-21snmpd21:50:420
2041185993825,9cyclictest2054142-21sshd23:19:450
2041195993730,4cyclictest2049408-21sshd21:45:423
2041195993730,4cyclictest2049408-21sshd21:45:423
2041195993726,6cyclictest2045536-21munin-plugin-st20:35:013
2041195993726,6cyclictest2045536-21munin-plugin-st20:35:003
2041195993725,9cyclictest37-21ksoftirqd/322:10:013
2041195993725,9cyclictest2043959-21sshd20:02:383
2041195993725,6cyclictest306-21in:imuxsock23:15:003
2041195993725,10cyclictest37-21ksoftirqd/321:15:003
2041195993722,10cyclictest272-21dbus-daemon23:10:003
2041192993729,5cyclictest2050979-21cron22:20:002
204119099379,6cyclictest131rcu_preempt22:24:591
204119099379,5cyclictest131rcu_preempt00:35:031
2041190993727,7cyclictest23-21ksoftirqd/119:45:021
2041190993722,11cyclictest23-21ksoftirqd/122:29:441
2041190993714,7cyclictest23-21ksoftirqd/123:05:031
2041190993714,7cyclictest23-21ksoftirqd/123:05:031
2041190993712,6cyclictest131rcu_preempt20:55:011
2041185993724,9cyclictest12-21ksoftirqd/021:50:020
2041185993724,9cyclictest12-21ksoftirqd/021:50:020
2041185993721,12cyclictest363-21snmpd20:05:230
2041185993721,12cyclictest363-21snmpd20:05:220
2041185993719,14cyclictest2045688-21cat20:35:030
2041185993719,14cyclictest2045688-21cat20:35:020
204118599371,32cyclictest0-21swapper/023:35:010
2041195993622,11cyclictest37-21ksoftirqd/319:55:003
2041195993622,11cyclictest37-21ksoftirqd/319:55:003
204119599361,9cyclictest2057817-21munin-run00:29:593
2041195993617,13cyclictest272-21dbus-daemon22:40:003
204119299366,8cyclictest131rcu_preempt22:10:022
204119299365,4cyclictest131rcu_preempt19:15:002
2041192993629,4cyclictest2041116-21latency_hist19:10:012
2041192993628,5cyclictest2045771-21sshd20:39:432
2041192993626,8cyclictest30-21ksoftirqd/220:00:022
2041192993626,8cyclictest30-21ksoftirqd/219:35:012
2041192993624,9cyclictest30-21ksoftirqd/223:25:012
2041192993624,9cyclictest30-21ksoftirqd/200:35:002
2041192993624,9cyclictest235-21systemd-journal00:30:002
2041192993623,9cyclictest235-21systemd-journal00:19:592
2041192993623,10cyclictest272-21dbus-daemon20:35:012
2041192993623,10cyclictest272-21dbus-daemon20:35:002
2041192993621,12cyclictest2053988-21sed23:15:012
2041192993619,13cyclictest2046295-21sshd20:47:422
204119299361,7cyclictest131rcu_preempt21:10:002
204119099367,5cyclictest131rcu_preempt22:35:011
2041190993624,8cyclictest23-21ksoftirqd/121:45:011
2041190993617,13cyclictest1-21systemd20:35:011
2041190993617,13cyclictest1-21systemd20:35:001
204119099361,15cyclictest23-21ksoftirqd/119:25:021
2041190993610,4cyclictest131rcu_preempt19:56:431
204118599369,23cyclictest235-21systemd-journal00:15:000
2041185993628,5cyclictest19050irq/34-mmc119:25:000
204118599362,6cyclictest2046047-21sshd20:43:430
2041185993623,9cyclictest2046546-21sshd20:52:440
204118599362,30cyclictest235-21systemd-journal22:59:350
204118599361,5cyclictest2050228-21munin-run22:05:010
204118599361,5cyclictest2050228-21munin-run22:05:000
204118599361,31cyclictest0-21swapper/022:45:500
204119599354,4cyclictest131rcu_preempt00:25:013
204119599354,3cyclictest131rcu_preempt21:24:593
2041195993528,4cyclictest2046568-21munin-plugin-st20:55:003
2041195993526,6cyclictest2046516-21latency_hist20:50:033
2041195993526,5cyclictest2046328-21kworker/3:121:45:003
2041195993525,8cyclictest37-21ksoftirqd/320:25:033
2041195993523,9cyclictest37-21ksoftirqd/320:25:023
2041195993521,10cyclictest2055161-21sshd23:35:443
2041195993520,10cyclictest272-21dbus-daemon22:25:003
2041195993520,10cyclictest0-21swapper/323:45:033
2041195993519,13cyclictest235-21systemd-journal21:30:013
2041195993519,12cyclictest37-21ksoftirqd/319:47:453
204119299354,14cyclictest2049175-21kworker/u8:321:55:012
2041192993528,5cyclictest30-21ksoftirqd/221:45:022
2041192993526,7cyclictest30-21ksoftirqd/221:30:022
2041192993521,11cyclictest272-21dbus-daemon21:15:002
2041192993520,10cyclictest306-21in:imuxsock19:50:032
2041192993520,10cyclictest306-21in:imuxsock19:50:022
2041192993517,13cyclictest272-21dbus-daemon00:10:012
2041192993517,13cyclictest272-21dbus-daemon00:10:012
204119099358,8cyclictest131rcu_preempt00:08:261
204119099358,8cyclictest131rcu_preempt00:08:251
2041190993522,10cyclictest2041189-21sed19:10:021
2041190993510,4cyclictest131rcu_preempt21:30:011
2041185993526,7cyclictest2045791-21sendmail20:40:000
2041185993525,7cyclictest12-21ksoftirqd/020:02:380
2041185993523,8cyclictest12-21ksoftirqd/021:10:000
2041195993422,8cyclictest235-21systemd-journal22:46:423
2041195993421,10cyclictest2054436-21latency_hist23:25:013
2041195993420,9cyclictest235-21systemd-journal20:45:003
2041195993417,13cyclictest272-21dbus-daemon22:35:013
2041192993427,5cyclictest30-21ksoftirqd/221:25:022
2041192993425,6cyclictest2049960-21modprobe22:00:012
204119299342,4cyclictest131rcu_preempt23:40:022
2041192993422,9cyclictest2049088-21sed21:40:012
2041192993418,12cyclictest235-21systemd-journal23:05:022
2041192993418,12cyclictest235-21systemd-journal23:05:012
204119099345,5cyclictest131rcu_preempt20:15:001
2041190993427,5cyclictest23-21ksoftirqd/100:35:011
2041190993427,5cyclictest23-21ksoftirqd/100:35:001
204119099342,6cyclictest131rcu_preempt22:55:021
2041185993422,9cyclictest12-21ksoftirqd/021:45:010
204118599341,30cyclictest0-21swapper/021:14:380
2041195993323,8cyclictest37-21ksoftirqd/323:46:453
2041195993322,8cyclictest2052855-21cron22:55:003
2041195993321,9cyclictest37-21ksoftirqd/300:08:123
2041195993321,9cyclictest37-21ksoftirqd/300:08:113
2041195993321,10cyclictest37-21ksoftirqd/321:39:473
204119599331,4cyclictest131rcu_preempt20:20:013
2041192993325,6cyclictest30-21ksoftirqd/223:54:592
2041192993324,6cyclictest306-21in:imuxsock22:25:012
204119299332,3cyclictest131rcu_preempt22:50:032
2041192993321,9cyclictest30-21ksoftirqd/223:30:022
2041190993324,7cyclictest23-21ksoftirqd/119:35:011
204118599331,29cyclictest0-21swapper/021:32:070
204118599331,29cyclictest0-21swapper/021:32:060
204119599326,5cyclictest131rcu_preempt19:11:253
2041195993223,7cyclictest37-21ksoftirqd/319:30:023
204119299324,4cyclictest131rcu_preempt23:00:002
2041192993219,9cyclictest235-21systemd-journal22:15:002
2041190993222,8cyclictest23-21ksoftirqd/122:15:021
2041185993220,9cyclictest235-21systemd-journal19:45:310
2041195993121,8cyclictest37-21ksoftirqd/319:10:013
204119299317,3cyclictest131rcu_preempt19:25:012
204119299312,24cyclictest281-21systemd-logind23:35:012
204118599311,4cyclictest0-21swapper/022:51:540
2041195993020,7cyclictest37-21ksoftirqd/320:15:013
2041195993019,8cyclictest2050741-21systemd-run22:15:003
2041192993015,9cyclictest2051777-21cut22:35:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional