You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 19:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Mon Dec 08, 2025 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1608989997368,3cyclictest0-21swapper/010:20:030
1608989997368,3cyclictest0-21swapper/010:20:020
160900499652,14cyclictest1619114-21munin-run10:25:003
160900499643,5cyclictest1618022-21sshd10:01:093
160900499631,14cyclictest1614621-21sshd08:59:013
160900499631,12cyclictest1625552-21sshd12:26:123
1608997996352,8cyclictest0-21swapper/207:10:022
1608997996344,12cyclictest235-21systemd-journal08:40:012
1609004996229,28cyclictest272-21dbus-daemon07:45:023
160900499622,5cyclictest1611508-21sshd07:59:423
160900499622,5cyclictest1611508-21sshd07:59:423
160900499622,14cyclictest1615418-21sshd09:14:033
160900499612,6cyclictest1621949-21/usr/sbin/munin11:20:013
160900499612,6cyclictest1621949-21/usr/sbin/munin11:20:003
160900499612,5cyclictest1623223-21sshd11:41:093
160900499602,13cyclictest1618288-21sshd10:09:043
160900499601,6cyclictest1612021-21sshd08:05:393
160899799601,5cyclictest131rcu_preempt10:15:012
160900499598,43cyclictest235-21systemd-journal11:40:023
160900499592,6cyclictest1619619-21munin-run10:35:023
160900499592,6cyclictest1619619-21munin-run10:35:013
160900499592,15cyclictest1613350-21munin-run08:35:003
160900499592,11cyclictest1621646-21sshd11:11:103
160900499591,7cyclictest1614152-21munin-run08:50:023
1609004995820,33cyclictest272-21dbus-daemon08:25:013
1609004995818,34cyclictest0-21swapper/309:55:003
160900499581,5cyclictest1610530-21munin-run07:40:013
160900499581,11cyclictest363-21snmpd12:18:353
1609004995728,26cyclictest1609674-21sed07:20:033
160900499572,7cyclictest1621148-21sshd11:02:103
160900499572,7cyclictest1618523-21sshd10:10:043
160900499572,5cyclictest1615979-21munin-run09:24:593
160900499572,5cyclictest1609733-21munin-run07:25:003
160900499572,11cyclictest48-21kcompactd012:05:133
160900499571,7cyclictest1614356-21sshd08:50:593
160900499571,5cyclictest1616194-21sshd09:25:033
160900499571,10cyclictest363-21snmpd11:58:473
160900499563,48cyclictest1613613-21run-parts08:40:003
160900499563,14cyclictest1622728-21modprobe11:35:013
160900499563,14cyclictest1622728-21modprobe11:35:003
160900499563,12cyclictest363-21snmpd12:38:553
160900499562,8cyclictest1610204-21sshd07:30:433
160900499562,6cyclictest1620139-21munin-run10:45:003
160900499562,6cyclictest1611772-21sshd08:00:433
160900499562,4cyclictest1611019-21munin-run07:50:003
160900499561,10cyclictest1622434-21sshd11:25:113
160900499552,6cyclictest363-21snmpd10:53:343
160900499552,5cyclictest1614900-21sshd09:03:593
1609004995521,28cyclictest306-21in:imuxsock11:50:013
160900499551,8cyclictest1615681-21sshd09:19:043
160900499551,8cyclictest1615681-21sshd09:19:033
160900499551,6cyclictest363-21snmpd10:48:323
160900499551,5cyclictest1613887-21munin-run08:45:013
160900499551,17cyclictest1616733-21modprobe09:39:593
160900499551,10cyclictest48-21kcompactd009:30:123
1608989995537,14cyclictest1-21systemd12:15:010
160900499542,4cyclictest1621395-21sshd11:06:103
160900499541,6cyclictest1623727-21sshd11:51:243
160900499541,4cyclictest1622184-21sshd11:20:103
160900499541,15cyclictest363-21snmpd12:30:493
1608997995436,13cyclictest1-21systemd12:00:002
1609004995327,22cyclictest271-21cron08:30:003
1609004995327,22cyclictest271-21cron08:30:003
1609004995326,24cyclictest37-21ksoftirqd/310:39:063
160900499532,4cyclictest1612288-21sshd08:13:573
160900499532,4cyclictest1612288-21sshd08:13:563
160900499531,8cyclictest363-21snmpd07:52:583
160900499531,12cyclictest1619315-21sshd10:25:053
1608997995311,7cyclictest131rcu_preempt09:40:022
1608989995343,6cyclictest1608999-21latency_hist07:10:010
160900499522,5cyclictest363-21snmpd08:18:133
160900499521,13cyclictest363-21snmpd12:24:303
160900499521,13cyclictest363-21snmpd09:06:093
160900499512,5cyclictest363-21snmpd09:55:203
160900499512,4cyclictest1624300-21systemd-run12:05:013
160900499511,5cyclictest1609166-21sshd07:12:423
1608989995134,13cyclictest272-21dbus-daemon09:35:010
160900499504,39cyclictest1618810-21cron10:20:013
160900499504,39cyclictest1618810-21cron10:20:003
160900499502,4cyclictest363-21snmpd09:46:523
1608992995034,11cyclictest235-21systemd-journal09:25:001
1608989995035,12cyclictest1626097-21systemctl12:39:590
1608989995035,12cyclictest1-21systemd11:30:010
1608989995034,12cyclictest1-21systemd10:15:010
160900499492,4cyclictest363-21snmpd12:11:483
160899299491,3cyclictest131rcu_preempt09:05:001
160898999492,41cyclictest1612847-21munin-run08:25:010
160898999491,5cyclictest0-21swapper/010:36:320
160900499482,4cyclictest363-21snmpd07:27:523
1608992994830,13cyclictest235-21systemd-journal09:26:031
160900499474,37cyclictest0-21swapper/309:45:013
1608997994733,9cyclictest272-21dbus-daemon11:50:022
1608997994732,10cyclictest1-21systemd07:15:012
1608992994732,12cyclictest23-21ksoftirqd/110:25:001
160898999472,40cyclictest1614645-21run-parts09:00:000
160900499462,7cyclictest363-21snmpd10:55:123
1608992994632,10cyclictest235-21systemd-journal11:35:021
1608992994625,14cyclictest272-21dbus-daemon08:05:001
160898999463,9cyclictest272-21dbus-daemon09:25:000
1608989994625,15cyclictest272-21dbus-daemon11:40:010
160900499451,12cyclictest1609146-21sed07:10:023
160899799458,6cyclictest131rcu_preempt08:30:002
160899799458,6cyclictest131rcu_preempt08:29:592
1608997994531,11cyclictest30-21ksoftirqd/211:05:012
1608997994530,13cyclictest30-21ksoftirqd/212:15:002
1608997994527,13cyclictest1-21systemd09:05:012
1608992994533,9cyclictest1609955-21sshd07:26:431
1608992994531,10cyclictest23-21ksoftirqd/110:15:001
160898999457,6cyclictest1613922-21latency_hist08:45:010
1608989994526,13cyclictest1612320-21systemd-run08:15:020
1608989994526,13cyclictest1612320-21systemd-run08:15:010
1608997994434,7cyclictest1620898-21sendmail11:00:002
1608997994433,8cyclictest1611780-21sshd08:02:432
1608992994428,12cyclictest363-21snmpd11:18:401
1608992994428,12cyclictest363-21snmpd11:18:391
160898999442,38cyclictest1612544-21sshd08:18:000
160899799435,33cyclictest1625812-21sshd12:32:112
1608997994322,15cyclictest272-21dbus-daemon11:15:012
1608992994332,9cyclictest23-21ksoftirqd/110:40:011
1608992994332,8cyclictest23-21ksoftirqd/112:15:021
1608992994324,14cyclictest235-21systemd-journal11:30:031
1608992994324,14cyclictest235-21systemd-journal11:30:031
1608989994336,4cyclictest16950irq/224-800000009:45:030
1608989994331,8cyclictest235-21systemd-journal09:00:590
1608997994231,6cyclictest1626090-21sendmail12:40:002
1608997994227,12cyclictest30-21ksoftirqd/207:20:002
1608997994227,11cyclictest235-21systemd-journal11:51:102
1608992994228,10cyclictest272-21dbus-daemon07:55:021
1608992994227,11cyclictest23-21ksoftirqd/108:25:001
1608989994235,4cyclictest16950irq/224-800000008:40:000
1608989994229,9cyclictest12-21ksoftirqd/009:29:590
1608989994229,10cyclictest12-21ksoftirqd/009:39:590
1608989994227,11cyclictest1-21systemd08:35:010
1608989994226,11cyclictest272-21dbus-daemon08:55:000
160898999422,5cyclictest131rcu_preempt09:45:000
160898999422,11cyclictest1617948-21sed10:00:020
1608997994133,5cyclictest1620628-21cron10:54:592
1608997994130,6cyclictest150-21pr/ttyS211:15:112
1608997994130,6cyclictest150-21pr/ttyS211:15:102
1608997994129,9cyclictest30-21ksoftirqd/207:50:002
1608997994126,11cyclictest272-21dbus-daemon10:20:002
1608997994126,11cyclictest272-21dbus-daemon10:20:002
1608997994124,12cyclictest30-21ksoftirqd/208:00:012
1608997994124,12cyclictest30-21ksoftirqd/208:00:002
1608997994122,14cyclictest1-21systemd10:30:002
1608992994129,9cyclictest1623265-21pluginstate11:45:021
160898999412,9cyclictest1611991-21sed08:05:020
1608989994127,9cyclictest306-21in:imuxsock07:35:000
1608989994127,9cyclictest1-21systemd12:35:010
1608989994124,12cyclictest1609493-21systemd-run07:20:010
1608989994122,13cyclictest12-21ksoftirqd/007:55:020
1608989994122,12cyclictest235-21systemd-journal09:54:590
1608989994117,18cyclictest272-21dbus-daemon11:10:010
1608989994114,18cyclictest12-21ksoftirqd/007:50:000
1608997994029,7cyclictest30-21ksoftirqd/210:05:022
160899799401,7cyclictest0-21swapper/209:20:002
160899799401,7cyclictest0-21swapper/209:20:002
1608992994031,6cyclictest23-21ksoftirqd/110:59:591
1608992994030,7cyclictest1616987-21sshd09:41:101
1608992994029,7cyclictest1622219-21munin-plugin-st11:25:001
1608992994027,9cyclictest306-21in:imuxsock07:35:031
1608992994027,7cyclictest23-21ksoftirqd/109:10:011
1608992994019,15cyclictest272-21dbus-daemon10:45:001
1608989994031,6cyclictest19050irq/34-mmc107:26:090
1608989994030,7cyclictest16950irq/224-800000010:41:100
160898999402,6cyclictest131rcu_preempt08:30:010
160898999402,6cyclictest131rcu_preempt08:30:010
1608989994021,14cyclictest1-21systemd11:50:010
1608989994021,13cyclictest235-21systemd-journal07:40:000
160899799398,5cyclictest131rcu_preempt12:26:292
160899799395,7cyclictest30-21ksoftirqd/210:45:012
1608997993929,6cyclictest1622460-21cron11:30:002
1608997993928,8cyclictest30-21ksoftirqd/211:40:022
1608997993925,10cyclictest272-21dbus-daemon09:30:002
1608997993923,11cyclictest272-21dbus-daemon09:10:012
1608997993922,12cyclictest272-21dbus-daemon12:25:012
1608992993929,7cyclictest23-21ksoftirqd/112:20:011
1608992993929,7cyclictest1615415-21sshd09:13:031
1608992993927,5cyclictest306-21in:imuxsock11:50:001
1608992993923,11cyclictest23-21ksoftirqd/107:45:001
1608992993920,14cyclictest272-21dbus-daemon08:00:011
1608992993920,14cyclictest272-21dbus-daemon08:00:001
1608989993922,12cyclictest1615176-21sendmail09:10:010
1608989993921,14cyclictest1-21systemd11:45:000
1608989993921,13cyclictest235-21systemd-journal07:25:000
1608989993919,14cyclictest1-21systemd12:25:010
1608989993910,7cyclictest12-21ksoftirqd/010:05:020
1608997993830,6cyclictest30-21ksoftirqd/208:50:022
1608997993829,5cyclictest30-21ksoftirqd/210:25:012
1608997993824,9cyclictest306-21in:imuxsock09:41:032
1608997993811,5cyclictest131rcu_preempt08:20:012
1608992993827,8cyclictest1610221-21cron07:34:591
1608992993824,10cyclictest1609417-21cron07:16:591
1608992993821,12cyclictest272-21dbus-daemon08:20:011
160898999388,7cyclictest131rcu_preempt09:20:010
160898999388,7cyclictest131rcu_preempt09:20:000
1608989993831,4cyclictest16950irq/224-800000012:30:000
1608989993831,4cyclictest16950irq/224-800000010:10:010
1608989993826,9cyclictest1621147-21sshd11:01:160
1608989993826,9cyclictest1614292-21sed08:50:030
160898999382,11cyclictest1-21systemd10:29:060
1608989993820,13cyclictest1-21systemd10:35:010
1608989993820,13cyclictest1-21systemd10:35:000
160898999381,33cyclictest235-21systemd-journal07:59:420
160898999381,33cyclictest235-21systemd-journal07:59:420
1608997993727,8cyclictest30-21ksoftirqd/211:10:002
1608997993726,8cyclictest30-21ksoftirqd/210:50:012
1608997993724,10cyclictest1610734-21sshd07:40:332
1608997993721,11cyclictest272-21dbus-daemon09:55:002
1608997993711,7cyclictest131rcu_preempt09:25:002
160899299375,9cyclictest23-21ksoftirqd/108:46:291
1608992993726,8cyclictest1620519-21sed10:50:021
1608992993724,10cyclictest235-21systemd-journal12:32:101
1608992993723,11cyclictest23-21ksoftirqd/112:01:111
1608992993718,14cyclictest1-21systemd10:20:021
1608992993718,14cyclictest1-21systemd10:20:011
160898999374,5cyclictest131rcu_preempt10:25:010
1608989993728,6cyclictest12-21ksoftirqd/011:00:010
1608989993726,7cyclictest12-21ksoftirqd/010:50:000
1608989993723,10cyclictest12-21ksoftirqd/011:25:000
1608989993722,11cyclictest1623744-21cron11:55:000
1608989993722,11cyclictest12-21ksoftirqd/011:33:430
1608989993722,11cyclictest12-21ksoftirqd/011:33:420
1608989993720,12cyclictest272-21dbus-daemon11:20:010
1608989993720,12cyclictest272-21dbus-daemon11:20:000
1608997993630,3cyclictest301ksoftirqd/208:35:002
1608997993627,7cyclictest30-21ksoftirqd/211:35:022
1608997993627,7cyclictest30-21ksoftirqd/211:35:012
1608997993626,7cyclictest30-21ksoftirqd/209:35:012
1608997993626,7cyclictest30-21ksoftirqd/207:25:022
1608997993624,8cyclictest1614086-21sed08:45:022
1608997993623,10cyclictest30-21ksoftirqd/211:25:002
1608997993620,11cyclictest272-21dbus-daemon09:00:002
1608992993627,5cyclictest1626090-21sendmail12:40:001
1608992993625,7cyclictest1624517-21sshd12:08:111
1608992993624,8cyclictest235-21systemd-journal11:14:261
1608992993624,8cyclictest23-21ksoftirqd/111:30:011
160899299362,3cyclictest131rcu_preempt08:55:031
1608992993620,12cyclictest1-21systemd07:25:021
1608989993620,13cyclictest1-21systemd12:20:010
160898999361,31cyclictest0-21swapper/009:11:030
1608997993527,5cyclictest1625184-21latency_hist12:20:032
1608997993527,5cyclictest1624539-21modprobe12:10:002
1608997993525,7cyclictest30-21ksoftirqd/208:05:032
1608997993524,9cyclictest30-21ksoftirqd/207:35:022
1608997993523,9cyclictest30-21ksoftirqd/210:10:012
1608997993521,10cyclictest235-21systemd-journal10:40:002
160899799351,5cyclictest131rcu_preempt08:55:032
160899799351,30cyclictest272-21dbus-daemon07:30:012
1608992993525,7cyclictest23-21ksoftirqd/108:34:591
1608992993525,7cyclictest23-21ksoftirqd/107:45:421
1608992993521,11cyclictest1617752-21sshd09:58:031
1608992993517,13cyclictest1-21systemd11:09:591
1608989993523,9cyclictest1624062-21ls12:00:010
1608989993520,10cyclictest272-21dbus-daemon12:05:010
160898999351,31cyclictest0-21swapper/007:45:010
160898999351,31cyclictest0-21swapper/007:13:590
160898999351,30cyclictest0-21swapper/008:08:420
160899799345,6cyclictest30-21ksoftirqd/207:55:032
1608997993423,8cyclictest30-21ksoftirqd/208:15:022
1608997993423,8cyclictest30-21ksoftirqd/208:15:012
1608997993423,8cyclictest30-21ksoftirqd/207:40:012
1608997993421,10cyclictest30-21ksoftirqd/209:46:042
160899299346,5cyclictest131rcu_preempt10:10:011
1608992993426,5cyclictest1613873-21cron08:45:011
1608992993426,4cyclictest306-21in:imuxsock09:53:041
1608992993424,7cyclictest23-21ksoftirqd/112:29:111
160899299342,3cyclictest131rcu_preempt09:20:011
160899299342,3cyclictest131rcu_preempt09:20:001
1608992993421,10cyclictest23-21ksoftirqd/110:55:001
160898999341,30cyclictest0-21swapper/011:11:160
1608997993323,5cyclictest306-21in:imuxsock10:35:012
1608997993323,5cyclictest306-21in:imuxsock10:35:012
1608997993316,13cyclictest1-21systemd10:00:002
1608992993326,4cyclictest1612279-21sshd08:11:571
1608992993326,4cyclictest1612279-21sshd08:11:561
160899299332,5cyclictest131rcu_preempt09:50:001
1608992993323,7cyclictest1616847-21sed09:40:021
1608992993322,8cyclictest23-21ksoftirqd/108:05:181
1608992993320,9cyclictest235-21systemd-journal07:11:261
1608992993319,11cyclictest1623845-21sed11:55:021
160899299331,3cyclictest131rcu_preempt07:10:021
1608989993320,10cyclictest235-21systemd-journal10:52:100
160898999331,28cyclictest0-21swapper/012:09:580
1608997993223,6cyclictest30-21ksoftirqd/209:15:022
1608997993217,12cyclictest1623357-21cat11:45:012
160899299325,3cyclictest131rcu_preempt08:40:001
160899299324,3cyclictest131rcu_preempt08:59:591
1608992993225,4cyclictest271-21cron12:24:591
1608992993225,4cyclictest1-21systemd09:35:001
1608992993222,7cyclictest1618016-21sshd10:00:031
160899799312,21cyclictest1-21systemd12:05:012
160899299316,20cyclictest1624002-21modprobe12:00:001
1608992993123,5cyclictest23-21ksoftirqd/110:30:021
1608992993122,3cyclictest0-21swapper/108:25:031
1608992993122,3cyclictest0-21swapper/108:25:021
1608992993121,8cyclictest23-21ksoftirqd/111:05:011
1608992993121,6cyclictest1619782-21cat10:35:031
1608992993121,6cyclictest1619782-21cat10:35:021
1608997993015,12cyclictest1612853-21sshd08:25:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional