You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 21:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Tue Jun 23, 2026 12:45:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
76932999106102,2cyclictest0-21swapper/007:45:010
76932999921,3cyclictest0-21swapper/009:05:030
769329999018,41cyclictest777811-21sed09:15:020
769329998831,30cyclictest0-21swapper/010:55:020
769329998533,18cyclictest770968-21sed07:40:030
769329998024,21cyclictest803577-21ssh10:09:060
769334997935,40cyclictest1-21systemd08:55:012
769329997930,17cyclictest823104-21ls10:50:020
769329997841,5cyclictest854035-21munin-run11:55:010
769329997841,5cyclictest854035-21munin-run11:55:010
769329997740,33cyclictest858122-21ssh12:03:260
769329997737,12cyclictest789886-21ssh09:40:050
769329997727,15cyclictest844911-21ssh11:35:310
769329997725,23cyclictest847781-21ssh11:41:380
769329997715,35cyclictest0-21swapper/011:35:020
769329997624,14cyclictest869478-21ssh12:26:580
769329997415,30cyclictest0-21swapper/009:50:010
769329997344,25cyclictest3467602-21systemd-journal11:16:040
769329997324,20cyclictest834277-21ssh11:13:380
769329997133,32cyclictest3467602-21systemd-journal10:45:010
769329997133,13cyclictest364-21snmpd11:57:240
769329997117,33cyclictest829977-21ssh11:04:390
769329997040,26cyclictest778188-21ssh09:15:310
769329997040,26cyclictest778188-21ssh09:15:300
769334996921,17cyclictest3467602-21systemd-journal11:45:012
769329996926,8cyclictest865992-21systemd-run12:20:010
769329996926,12cyclictest0-21swapper/010:40:020
769329996915,29cyclictest0-21swapper/008:07:370
769329996819,15cyclictest780705-21rm09:20:430
769329996814,29cyclictest150-21pr/ttyS211:30:030
769329996734,4cyclictest815689-21munin-run10:35:010
769329996731,31cyclictest771831-21sshd07:59:360
769329996724,16cyclictest0-21swapper/010:13:510
769329996631,31cyclictest0-21swapper/008:52:400
769329996630,12cyclictest842057-21ssh11:30:000
769329996624,11cyclictest850512-21ssh11:47:270
769329996623,39cyclictest0-21swapper/010:20:020
769329996622,39cyclictest798422-21ssh09:58:250
769329996622,39cyclictest798422-21ssh09:58:250
769339996530,5cyclictest309-21in:imuxsock11:30:003
769339996530,5cyclictest309-21in:imuxsock11:30:003
769334996524,7cyclictest30-21ksoftirqd/209:10:012
769329996525,14cyclictest775496-21diskmemload10:03:290
769334996429,8cyclictest30-21ksoftirqd/211:19:452
769329996430,31cyclictest150-21pr/ttyS211:07:210
769329996420,39cyclictest868525-21date12:25:020
769334996325,5cyclictest794671-21sh09:50:062
769331996314,20cyclictest813600-21ssh10:30:021
769329996330,28cyclictest150-21pr/ttyS212:08:190
769334996227,11cyclictest30-21ksoftirqd/210:55:002
769334996225,11cyclictest30-21ksoftirqd/210:08:222
769329996221,36cyclictest786889-21ssh09:34:070
769329996220,39cyclictest0-21swapper/009:28:010
769329996212,22cyclictest0-21swapper/010:58:040
769334996121,12cyclictest30-21ksoftirqd/212:07:402
769329996131,26cyclictest150-21pr/ttyS210:21:450
769329996125,6cyclictest811758-21ssh10:26:220
769329996120,10cyclictest796829-21munin-run09:55:010
76933999602,4cyclictest131rcu_preempt11:50:003
769334996028,12cyclictest1-21systemd09:30:012
769334996027,11cyclictest30-21ksoftirqd/212:05:012
769334996022,11cyclictest30-21ksoftirqd/211:31:442
76932999609,38cyclictest19350irq/34-mmc107:25:020
769329996049,9cyclictest150-21pr/ttyS212:37:570
769329996047,10cyclictest774181-21sshd08:42:390
769329996042,14cyclictest872983-21sshd12:34:380
769339995929,11cyclictest37-21ksoftirqd/310:30:003
769334995926,9cyclictest30-21ksoftirqd/209:14:542
769329995945,11cyclictest773903-21sshd08:38:370
769339995830,5cyclictest309-21in:imuxsock08:39:593
769329995846,9cyclictest3467602-21systemd-journal12:12:170
769329995846,9cyclictest3467602-21systemd-journal12:12:160
769329995845,10cyclictest770542-21sshd07:34:380
769334995723,11cyclictest30-21ksoftirqd/209:48:552
769329995745,9cyclictest772594-21sshd08:10:370
769329995744,10cyclictest789511-21sshd09:39:380
769329995744,10cyclictest770023-21sshd07:20:370
769329995742,12cyclictest773134-21sshd08:20:380
769329995726,4cyclictest771564-21sshd07:51:370
769339995638,14cyclictest1-21systemd12:35:013
769334995646,6cyclictest849226-21kworker/2:211:50:162
769334995646,6cyclictest849226-21kworker/2:211:50:162
769329995647,5cyclictest771327-21sshd07:49:370
769329995643,9cyclictest773655-21sshd08:34:180
769329995618,33cyclictest0-21swapper/011:23:020
769329995537,13cyclictest772853-21cron08:17:010
769329995537,13cyclictest772853-21cron08:17:010
769329995437,13cyclictest364-21snmpd08:45:060
769329995436,14cyclictest775219-21sshd09:03:370
769334995337,12cyclictest1-21systemd12:15:012
769334995337,12cyclictest1-21systemd12:15:012
769329995338,10cyclictest364-21snmpd08:59:220
769329995331,18cyclictest773433-21munin-run08:30:010
769334995224,9cyclictest30-21ksoftirqd/209:58:282
769334995224,9cyclictest30-21ksoftirqd/209:58:272
769331995235,13cyclictest275-21dbus-daemon09:35:011
769331995235,13cyclictest1-21systemd09:50:011
769331995221,16cyclictest3467602-21systemd-journal11:55:011
769331995221,16cyclictest3467602-21systemd-journal11:55:011
769329995227,19cyclictest769514-21latency_hist07:15:000
769339995137,10cyclictest275-21dbus-daemon11:45:013
769334995143,5cyclictest863672-21kworker/2:312:23:252
769334995143,5cyclictest774170-21kworker/2:111:58:592
769334995143,5cyclictest765012-21kworker/2:209:20:562
76933499514,34cyclictest822533-21kworker/u8:211:25:032
76933499514,34cyclictest822533-21kworker/u8:211:25:022
769334995142,5cyclictest765012-21kworker/2:209:40:082
769329995138,9cyclictest772105-21sshd08:04:100
769329995131,15cyclictest769756-21sshd07:18:360
769334995041,6cyclictest765012-21kworker/2:207:15:012
769334995041,5cyclictest774170-21kworker/2:110:43:072
769331995022,21cyclictest0-21swapper/111:45:011
76933999498,4cyclictest131rcu_preempt11:24:173
769334994941,5cyclictest796825-21kworker/2:311:37:212
769334994941,5cyclictest774170-21kworker/2:111:09:372
769334994941,5cyclictest774170-21kworker/2:110:00:382
769334994941,5cyclictest765012-21kworker/2:207:45:012
769334994940,6cyclictest774170-21kworker/2:109:38:252
769334994940,6cyclictest765012-21kworker/2:208:45:012
769334994936,9cyclictest3467602-21systemd-journal11:50:002
769334994933,12cyclictest808799-21pluginstate10:20:022
76933199495,3cyclictest131rcu_preempt08:05:001
769331994933,12cyclictest3467602-21systemd-journal07:30:001
769331994933,12cyclictest275-21dbus-daemon09:45:001
76933199491,4cyclictest131rcu_preempt10:20:001
769334994840,5cyclictest774170-21kworker/2:110:35:392
76933199484,3cyclictest131rcu_preempt10:41:401
769331994839,7cyclictest23-21ksoftirqd/109:55:011
769331994830,14cyclictest1-21systemd12:05:001
769331994829,12cyclictest871249-21diskmemload12:30:331
769331994820,8cyclictest23-21ksoftirqd/110:51:411
769339994729,14cyclictest275-21dbus-daemon12:15:013
769339994729,14cyclictest275-21dbus-daemon12:15:013
769334994739,5cyclictest796825-21kworker/2:310:27:192
76933499472,4cyclictest131rcu_preempt12:30:532
76933999469,6cyclictest131rcu_preempt10:55:403
769339994634,10cyclictest870757-21cron12:29:593
769339994633,10cyclictest808126-21sshd10:18:373
76933999461,4cyclictest131rcu_preempt08:05:003
769334994638,5cyclictest868406-21kworker/2:012:36:032
769334994638,5cyclictest765012-21kworker/2:209:16:522
769334994638,5cyclictest765012-21kworker/2:209:16:522
76933499463,5cyclictest131rcu_preempt07:40:012
76933199464,3cyclictest131rcu_preempt11:46:581
76933199463,3cyclictest131rcu_preempt11:09:511
76933199463,3cyclictest131rcu_preempt10:21:411
769331994626,14cyclictest23-21ksoftirqd/112:30:001
76933999459,4cyclictest131rcu_preempt10:35:243
769339994531,11cyclictest275-21dbus-daemon07:20:003
76933999451,7cyclictest828707-21ssh11:01:513
76933999451,4cyclictest131rcu_preempt10:07:513
76933999451,11cyclictest772889-21sh08:20:013
76933999451,11cyclictest772889-21sh08:20:013
769334994530,10cyclictest275-21dbus-daemon08:40:012
769334994529,13cyclictest1-21systemd12:20:012
769331994534,8cyclictest23-21ksoftirqd/110:10:011
769331994528,11cyclictest813373-21cut10:30:011
76933199452,3cyclictest131rcu_preempt09:23:021
769329994527,15cyclictest769350-21latency_hist07:10:020
76933999448,6cyclictest131rcu_preempt09:38:573
76933999448,6cyclictest131rcu_preempt09:22:023
76933999444,4cyclictest131rcu_preempt09:45:303
76933999444,3cyclictest131rcu_preempt10:52:383
76933999442,7cyclictest845334-21ssh11:36:343
76933999442,4cyclictest131rcu_preempt10:40:353
76933999441,6cyclictest0-21swapper/309:13:113
76933999441,4cyclictest131rcu_preempt12:02:093
76933999441,4cyclictest131rcu_preempt09:30:273
769334994437,4cyclictest765012-21kworker/2:209:32:322
769334994436,5cyclictest863672-21kworker/2:312:25:352
769334994436,5cyclictest796825-21kworker/2:311:00:412
769334994436,5cyclictest796825-21kworker/2:310:33:492
769334994434,6cyclictest772138-21kworker/2:008:32:362
769334994424,14cyclictest275-21dbus-daemon08:15:012
769331994431,10cyclictest3467602-21systemd-journal11:15:381
769331994430,11cyclictest844463-21systemd-run11:35:001
769331994428,11cyclictest775225-21sshd09:04:251
769331994427,12cyclictest0-21swapper/111:25:031
76933199442,3cyclictest131rcu_preempt11:29:181
76933199442,3cyclictest131rcu_preempt11:29:171
76933999437,5cyclictest131rcu_preempt08:00:023
76933999435,5cyclictest131rcu_preempt11:57:543
76933999433,8cyclictest37-21ksoftirqd/310:50:023
769339994331,7cyclictest274-21cron09:20:003
769339994331,7cyclictest274-21cron09:20:003
769339994329,11cyclictest37-21ksoftirqd/309:55:033
769339994329,11cyclictest37-21ksoftirqd/309:55:033
76933999432,4cyclictest131rcu_preempt11:06:583
76933999431,4cyclictest131rcu_preempt10:14:563
76933999431,3cyclictest131rcu_preempt12:16:483
76933999431,37cyclictest1-21systemd09:00:013
769334994335,5cyclictest796825-21kworker/2:310:58:092
769334994330,10cyclictest3467602-21systemd-journal10:14:012
769334994327,12cyclictest30-21ksoftirqd/208:05:022
76933499432,6cyclictest0-21swapper/211:15:012
769334994326,12cyclictest275-21dbus-daemon07:30:002
76933199433,33cyclictest309-21in:imuxsock07:34:591
769331994328,11cyclictest23-21ksoftirqd/112:25:011
769331994327,11cyclictest275-21dbus-daemon10:00:011
769331994327,11cyclictest275-21dbus-daemon10:00:001
769331994324,13cyclictest3467602-21systemd-journal08:00:011
76933199431,3cyclictest131rcu_preempt10:37:141
76933199431,3cyclictest131rcu_preempt09:29:331
76933999423,9cyclictest37-21ksoftirqd/311:53:353
76933999423,9cyclictest37-21ksoftirqd/311:53:343
76933999422,4cyclictest131rcu_preempt12:05:583
76933999421,4cyclictest131rcu_preempt09:52:213
76933999421,3cyclictest131rcu_preempt10:21:383
769334994234,5cyclictest796825-21kworker/2:311:20:182
769334994234,5cyclictest765012-21kworker/2:207:52:372
769334994233,6cyclictest774170-21kworker/2:110:45:382
769334994233,5cyclictest774950-21cron09:00:002
76933199423,3cyclictest131rcu_preempt12:20:011
769331994230,8cyclictest800568-21sshd10:02:391
769331994221,15cyclictest3467602-21systemd-journal07:40:011
76933999417,6cyclictest131rcu_preempt09:41:103
76933999416,5cyclictest131rcu_preempt07:10:363
76933999415,8cyclictest37-21ksoftirqd/311:18:493
76933999412,8cyclictest874741-21ssh12:38:083
769339994128,10cyclictest1-21systemd07:25:013
76933999412,10cyclictest755482-21munin-node10:30:393
769339994113,18cyclictest37-21ksoftirqd/311:30:173
769334994133,5cyclictest765012-21kworker/2:208:45:362
76933199413,7cyclictest3467602-21systemd-journal12:00:011
76933199412,3cyclictest131rcu_preempt09:12:441
76933999405,4cyclictest131rcu_preempt10:00:033
76933999404,4cyclictest131rcu_preempt09:10:003
76933999403,4cyclictest131rcu_preempt11:14:593
769339994029,8cyclictest771608-21systemd-run07:55:013
76933999401,4cyclictest131rcu_preempt12:23:043
76933999401,3cyclictest131rcu_preempt07:30:003
76933499406,5cyclictest131rcu_preempt10:23:022
769334994028,9cyclictest1-21systemd07:50:012
769334994026,11cyclictest30-21ksoftirqd/207:20:012
769331994029,8cyclictest23-21ksoftirqd/108:35:021
769331994028,7cyclictest309-21in:imuxsock07:15:011
769331994026,11cyclictest23-21ksoftirqd/110:58:281
769331994026,11cyclictest23-21ksoftirqd/109:18:521
769331994026,11cyclictest23-21ksoftirqd/109:18:511
769331994024,9cyclictest309-21in:imuxsock08:29:591
769331994023,12cyclictest23-21ksoftirqd/107:55:001
76933199401,3cyclictest131rcu_preempt10:12:101
769331994010,23cyclictest775505-21ssh09:09:591
76933999397,7cyclictest37-21ksoftirqd/308:25:023
769339993932,5cyclictest37-21ksoftirqd/307:45:023
76933999392,4cyclictest131rcu_preempt09:27:133
76933999391,6cyclictest0-21swapper/308:47:383
76933499391,3cyclictest131rcu_preempt07:25:022
76933199395,25cyclictest774713-21modprobe08:55:001
769331993929,7cyclictest873619-21sshd12:35:381
769331993928,7cyclictest774966-21sh08:59:591
769331993927,9cyclictest23-21ksoftirqd/108:45:011
769331993927,10cyclictest23-21ksoftirqd/111:13:461
769331993926,10cyclictest23-21ksoftirqd/108:05:381
769331993925,9cyclictest1-21systemd07:20:011
76933199392,4cyclictest131rcu_preempt10:50:001
769331993924,12cyclictest23-21ksoftirqd/112:15:011
769331993924,12cyclictest23-21ksoftirqd/112:15:011
769331993924,11cyclictest3467602-21systemd-journal12:10:011
769331993924,10cyclictest846882-21systemd-run11:40:011
76933999389,21cyclictest0-21swapper/308:52:383
76933499382,5cyclictest131rcu_preempt08:26:382
76933199381,3cyclictest131rcu_preempt11:02:411
76933999374,3cyclictest131rcu_preempt07:35:013
769339993728,5cyclictest309-21in:imuxsock08:45:013
76933999372,4cyclictest131rcu_preempt07:10:023
769339993721,12cyclictest3467602-21systemd-journal07:35:373
769331993726,7cyclictest23-21ksoftirqd/108:20:011
769331993726,7cyclictest23-21ksoftirqd/108:20:001
769331993725,9cyclictest773183-21pluginstate08:25:011
769331993723,10cyclictest0-21swapper/107:25:011
769331993713,16cyclictest275-21dbus-daemon07:50:001
76933999365,27cyclictest771356-21unin-run07:50:003
769334993625,8cyclictest772480-21cat08:10:012
769331993623,8cyclictest773919-21modprobe08:40:001
769331993613,16cyclictest3467602-21systemd-journal08:15:011
769339993520,11cyclictest275-21dbus-daemon08:10:003
769334993524,9cyclictest30-21ksoftirqd/209:05:002
76933499351,4cyclictest131rcu_preempt08:20:012
76933499351,4cyclictest131rcu_preempt08:20:012
76933499351,4cyclictest131rcu_preempt07:33:382
769331993528,5cyclictest23-21ksoftirqd/108:50:031
769331993525,7cyclictest23-21ksoftirqd/109:35:211
76933999343,3cyclictest131rcu_preempt08:25:023
769334993422,9cyclictest30-21ksoftirqd/208:00:012
769339993319,9cyclictest309-21in:imuxsock08:35:013
769334993322,9cyclictest30-21ksoftirqd/208:25:022
76933999312,3cyclictest131rcu_preempt09:03:383
76933999303,3cyclictest131rcu_preempt08:15:013
769331993019,8cyclictest23-21ksoftirqd/107:40:111
76933199292,20cyclictest769442-21wc07:10:011
769334992416,5cyclictest769255-21latency_hist07:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional