You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-20 - 05:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Fri Nov 20, 2026 00:45:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
724449910116,61cyclictest0-21swapper/022:00:000
72444999012,45cyclictest0-21swapper/000:30:020
72444999012,45cyclictest0-21swapper/000:30:020
72444998319,40cyclictest150-21pr/ttyS200:06:460
72444997927,14cyclictest108285-21sshd22:13:330
72444997914,46cyclictest0-21swapper/023:16:150
7244499755,35cyclictest0-21swapper/022:55:320
72444997520,18cyclictest150614-21munin-run23:45:010
72444997516,21cyclictest140686-21ssh23:23:200
7244499723,33cyclictest0-21swapper/022:45:510
72444997223,15cyclictest0-21swapper/023:37:420
72444997020,14cyclictest88497-21ssh21:30:460
72444997011,23cyclictest98110-21rm21:51:310
72444996923,14cyclictest150914-21ssh23:45:150
72444996922,14cyclictest0-21swapper/020:15:020
72444996918,18cyclictest80748-21ssh21:14:300
72444996824,12cyclictest134555-21latency_hist23:10:020
72444996819,17cyclictest78667-21diskmemload00:00:320
7244499679,13cyclictest163110-21ssh00:11:430
72444996633,4cyclictest168463-21sshd00:23:340
72444996627,35cyclictest150-21pr/ttyS220:05:010
72444996626,11cyclictest97428-21ls21:50:020
72452996512,10cyclictest30-21ksoftirqd/223:30:022
7244499657,31cyclictest0-21swapper/023:32:450
72444996518,15cyclictest88052-21sed21:30:030
72444996422,40cyclictest0-21swapper/022:17:560
72452996316,12cyclictest30-21ksoftirqd/221:34:422
72444996329,30cyclictest116248-21ssh22:30:100
72444996318,13cyclictest114898-21sh22:27:270
72452996222,24cyclictest0-21swapper/223:45:032
72444996225,33cyclictest0-21swapper/022:37:070
72444996225,33cyclictest0-21swapper/022:37:070
72444996219,13cyclictest142986-21ssh23:28:310
72444996213,34cyclictest157509-21ssh23:59:550
72452996119,9cyclictest30-21ksoftirqd/200:15:022
72452996112,8cyclictest30-21ksoftirqd/221:51:112
72444996136,7cyclictest364-21snmpd22:43:140
72444996129,18cyclictest275-21dbus-daemon20:00:000
72444996119,40cyclictest0-21swapper/022:53:350
7245699607,9cyclictest37-21ksoftirqd/300:34:143
72456996025,24cyclictest37-21ksoftirqd/320:15:013
72452996018,10cyclictest30-21ksoftirqd/200:15:392
7244499608,23cyclictest78667-21diskmemload21:38:130
72444996020,10cyclictest0-21swapper/000:36:380
72444996016,39cyclictest3467602-21systemd-journal20:45:000
7245699596,12cyclictest37-21ksoftirqd/320:35:003
72452995921,9cyclictest30-21ksoftirqd/223:50:022
72452995919,11cyclictest30-21ksoftirqd/221:48:472
72452995918,9cyclictest30-21ksoftirqd/223:40:012
72452995915,10cyclictest30-21ksoftirqd/222:09:172
72444995938,17cyclictest113462-21sshd22:24:320
72444995918,37cyclictest0-21swapper/021:10:020
72452995815,8cyclictest30-21ksoftirqd/221:15:582
72448995850,6cyclictest23-21ksoftirqd/100:10:031
72444995816,13cyclictest172357-21sh00:31:490
7245699579,5cyclictest131rcu_preempt23:35:373
7245699578,5cyclictest131rcu_preempt00:20:003
72452995718,6cyclictest30-21ksoftirqd/219:40:022
72444995745,8cyclictest16950irq/224-800000022:05:010
7245699568,13cyclictest37-21ksoftirqd/321:40:013
7245699566,7cyclictest37-21ksoftirqd/323:57:343
72456995611,6cyclictest131rcu_preempt23:22:583
7245699561,14cyclictest37-21ksoftirqd/323:41:343
7245299562,11cyclictest30-21ksoftirqd/222:15:032
72452995613,9cyclictest30-21ksoftirqd/200:30:022
72452995613,9cyclictest30-21ksoftirqd/200:30:012
72444995641,11cyclictest72871-21sshd19:17:560
72444995631,20cyclictest275-21dbus-daemon20:20:000
7245699557,9cyclictest37-21ksoftirqd/322:50:253
7245699557,12cyclictest37-21ksoftirqd/321:47:533
7245699556,10cyclictest37-21ksoftirqd/319:25:043
7245699555,15cyclictest37-21ksoftirqd/322:46:293
7245699554,12cyclictest37-21ksoftirqd/300:06:233
7245699552,14cyclictest0-21swapper/321:05:023
7245699552,14cyclictest0-21swapper/321:05:023
7245299554,8cyclictest30-21ksoftirqd/222:51:372
72452995516,8cyclictest30-21ksoftirqd/223:05:202
72452995510,9cyclictest30-21ksoftirqd/200:33:042
72444995521,8cyclictest12-21ksoftirqd/021:17:260
72444995520,30cyclictest92962-21ssh21:40:110
7245699547,13cyclictest37-21ksoftirqd/300:40:013
7245699545,12cyclictest37-21ksoftirqd/321:20:293
72456995413,5cyclictest131rcu_preempt23:02:273
72456995413,5cyclictest131rcu_preempt21:26:063
7245699541,17cyclictest37-21ksoftirqd/321:33:163
7245299545,8cyclictest30-21ksoftirqd/200:10:022
7245299545,10cyclictest0-21swapper/221:40:002
72452995413,8cyclictest30-21ksoftirqd/221:25:012
72452995412,8cyclictest30-21ksoftirqd/219:20:002
72448995437,13cyclictest1-21systemd21:40:001
72444995446,4cyclictest77632-21munin-run20:50:010
72444995439,11cyclictest76558-21sshd20:25:340
72444995438,12cyclictest78398-21sshd21:04:340
72444995438,12cyclictest78398-21sshd21:04:340
72444995427,12cyclictest153812-21ssh23:51:370
72444995427,12cyclictest153812-21ssh23:51:370
7244499542,28cyclictest0-21swapper/022:10:010
7245699537,10cyclictest37-21ksoftirqd/321:45:013
72456995310,5cyclictest131rcu_preempt22:05:023
7245299537,7cyclictest30-21ksoftirqd/223:35:012
72452995313,8cyclictest30-21ksoftirqd/221:14:282
72444995349,2cyclictest0-21swapper/019:15:020
72444995339,11cyclictest74480-21sshd19:45:340
72444995338,11cyclictest75549-21munin-run20:10:010
72444995338,11cyclictest73340-21cat19:25:030
72444995338,11cyclictest73340-21cat19:25:030
72444995338,11cyclictest166083-21sshd00:18:330
72444995337,12cyclictest73478-21munin-run19:30:000
72444995337,12cyclictest150-21pr/ttyS220:22:180
72444995333,4cyclictest132153-21munin-run23:05:010
7245699528,5cyclictest131rcu_preempt21:16:193
7245699524,7cyclictest37-21ksoftirqd/321:53:253
7245699523,8cyclictest37-21ksoftirqd/300:15:033
72456995212,6cyclictest131rcu_preempt22:43:263
72456995211,6cyclictest131rcu_preempt22:25:093
7245299529,10cyclictest30-21ksoftirqd/223:58:062
7245299528,10cyclictest30-21ksoftirqd/222:23:082
7245299527,11cyclictest30-21ksoftirqd/221:42:382
7245299524,6cyclictest30-21ksoftirqd/222:59:422
7245299522,6cyclictest30-21ksoftirqd/223:21:332
7245299522,10cyclictest78148-21modprobe21:00:002
72448995232,15cyclictest111299-21run-parts22:20:001
72444995240,8cyclictest77082-21sshd20:39:340
72444995239,9cyclictest74752-21sshd19:54:340
72444995239,10cyclictest74236-21sshd19:42:340
72444995236,13cyclictest77885-21munin-run20:55:010
72444995229,18cyclictest73990-21munin-run19:40:010
72444995227,20cyclictest134876-21ssh23:10:280
72444995222,14cyclictest85159-21ssh21:23:560
7245699519,8cyclictest37-21ksoftirqd/322:19:533
7245699519,10cyclictest37-21ksoftirqd/323:29:463
7245699518,11cyclictest37-21ksoftirqd/322:38:073
7245699518,11cyclictest37-21ksoftirqd/322:38:063
7245699517,12cyclictest37-21ksoftirqd/322:21:453
7245699516,8cyclictest37-21ksoftirqd/322:06:163
72456995134,12cyclictest3467602-21systemd-journal23:00:013
7245299516,8cyclictest30-21ksoftirqd/222:28:372
7245299516,8cyclictest30-21ksoftirqd/219:15:012
7245299514,11cyclictest30-21ksoftirqd/222:00:552
72452995135,11cyclictest1-21systemd00:25:012
72452995115,7cyclictest30-21ksoftirqd/222:35:212
72452995115,7cyclictest30-21ksoftirqd/222:35:212
72452995115,7cyclictest30-21ksoftirqd/222:32:112
7244899516,35cyclictest157545-40mandb00:00:021
72448995137,4cyclictest0-21swapper/123:45:031
72444995138,10cyclictest73697-21sshd19:31:340
7245699509,10cyclictest37-21ksoftirqd/321:58:503
7245699507,12cyclictest37-21ksoftirqd/323:07:553
7245699506,7cyclictest37-21ksoftirqd/319:25:003
7245699506,7cyclictest37-21ksoftirqd/319:25:003
7245699506,7cyclictest131rcu_preempt00:23:053
7245699504,9cyclictest37-21ksoftirqd/300:00:203
72456995012,5cyclictest131rcu_preempt23:45:073
7245699501,17cyclictest37-21ksoftirqd/323:15:033
72456995010,11cyclictest37-21ksoftirqd/319:20:003
7245299506,4cyclictest131rcu_preempt23:00:332
7245299505,9cyclictest30-21ksoftirqd/221:55:142
7245299505,6cyclictest30-21ksoftirqd/200:03:432
72452995015,8cyclictest30-21ksoftirqd/223:50:252
72452995015,8cyclictest30-21ksoftirqd/223:50:242
72452995011,11cyclictest30-21ksoftirqd/222:16:042
72444995024,19cyclictest72446-21sort19:10:020
7245699492,7cyclictest37-21ksoftirqd/323:51:223
7245699492,7cyclictest37-21ksoftirqd/323:51:223
72456994915,6cyclictest131rcu_preempt21:12:223
72456994912,6cyclictest131rcu_preempt23:15:523
7245299498,8cyclictest30-21ksoftirqd/223:16:152
7245299493,9cyclictest30-21ksoftirqd/221:27:072
72452994911,10cyclictest30-21ksoftirqd/222:46:332
72448994931,13cyclictest275-21dbus-daemon19:20:001
72444994935,10cyclictest364-21snmpd20:30:400
7245699487,8cyclictest37-21ksoftirqd/300:28:273
7245699487,8cyclictest37-21ksoftirqd/300:28:263
7245699486,6cyclictest131rcu_preempt22:34:033
7245699485,8cyclictest37-21ksoftirqd/323:33:463
72456994812,6cyclictest131rcu_preempt22:10:383
7245299486,9cyclictest30-21ksoftirqd/219:45:002
7245299485,8cyclictest30-21ksoftirqd/223:13:312
7245299483,8cyclictest30-21ksoftirqd/200:35:392
72448994835,9cyclictest3467602-21systemd-journal20:40:011
72448994833,12cyclictest116179-21latency_hist22:30:031
72444994839,5cyclictest78144-21munin-run21:00:000
72456994712,6cyclictest131rcu_preempt20:09:353
72456994711,9cyclictest37-21ksoftirqd/320:55:013
7245299477,6cyclictest30-21ksoftirqd/219:50:022
7245299476,7cyclictest30-21ksoftirqd/221:09:342
7245299474,9cyclictest30-21ksoftirqd/222:41:042
72448994733,11cyclictest23-21ksoftirqd/122:40:001
72448994733,11cyclictest23-21ksoftirqd/122:40:001
7244899471,41cyclictest148243-21modprobe23:40:001
7245699469,6cyclictest131rcu_preempt19:55:013
7245699464,9cyclictest37-21ksoftirqd/320:00:003
7245699464,12cyclictest37-21ksoftirqd/320:17:003
7245299467,6cyclictest30-21ksoftirqd/220:15:012
7245299464,8cyclictest30-21ksoftirqd/220:40:012
7245299463,8cyclictest30-21ksoftirqd/220:17:012
7245299462,38cyclictest275-21dbus-daemon19:55:012
72448994631,11cyclictest275-21dbus-daemon21:45:011
7245699454,5cyclictest131rcu_preempt21:10:013
7245699454,10cyclictest37-21ksoftirqd/320:40:013
7245299456,9cyclictest30-21ksoftirqd/219:35:002
7245299455,8cyclictest30-21ksoftirqd/221:05:012
7245299455,8cyclictest30-21ksoftirqd/221:05:012
72448994532,10cyclictest166083-21sshd00:18:331
72448994531,11cyclictest104334-21systemd-run22:05:011
7245699447,7cyclictest37-21ksoftirqd/319:50:023
7245699445,8cyclictest37-21ksoftirqd/320:02:343
72456994411,5cyclictest131rcu_preempt19:15:033
72452994430,10cyclictest1-21systemd19:25:012
72452994430,10cyclictest1-21systemd19:25:012
7244899443,5cyclictest131rcu_preempt20:48:351
7244899443,11cyclictest162183-21sh00:10:001
7245699431,7cyclictest0-21swapper/319:31:343
7245299434,9cyclictest30-21ksoftirqd/220:25:002
7245299433,8cyclictest30-21ksoftirqd/220:10:002
72452994336,4cyclictest64334-21kworker/2:119:29:472
7245299432,7cyclictest30-21ksoftirqd/220:00:002
7244899437,6cyclictest131rcu_preempt22:14:151
72448994330,10cyclictest23-21ksoftirqd/122:06:081
72448994320,14cyclictest116288-21ssh22:30:161
72448994317,21cyclictest221rcuc/123:43:341
7244899431,12cyclictest23-21ksoftirqd/123:05:271
7245699421,6cyclictest0-21swapper/321:00:003
72456994215,7cyclictest131rcu_preempt19:45:013
7245299427,6cyclictest30-21ksoftirqd/220:55:032
7245299425,7cyclictest30-21ksoftirqd/220:05:022
7245299424,10cyclictest30-21ksoftirqd/220:34:342
72448994233,6cyclictest1-21systemd23:05:031
7244899422,9cyclictest23-21ksoftirqd/100:35:201
7244899422,8cyclictest80985-21munin-run21:15:011
72448994227,11cyclictest23-21ksoftirqd/119:55:031
72448994223,10cyclictest23-21ksoftirqd/121:10:011
72448994222,7cyclictest23-21ksoftirqd/123:29:451
72448994219,19cyclictest23-21ksoftirqd/121:27:081
7244899421,5cyclictest0-21swapper/123:51:421
7244899421,5cyclictest0-21swapper/123:51:421
7244899421,4cyclictest131rcu_preempt21:59:171
72456994130,7cyclictest3467602-21systemd-journal20:47:343
7244899418,6cyclictest131rcu_preempt19:15:011
7244899418,4cyclictest131rcu_preempt22:55:011
7244899414,4cyclictest131rcu_preempt23:12:031
7244899413,6cyclictest131rcu_preempt23:33:021
72448994126,11cyclictest23-21ksoftirqd/122:49:491
72448994125,13cyclictest23-21ksoftirqd/121:20:001
72448994125,12cyclictest23-21ksoftirqd/121:31:331
72448994111,15cyclictest23-21ksoftirqd/121:51:461
7245699405,8cyclictest37-21ksoftirqd/320:25:003
72452994023,12cyclictest275-21dbus-daemon20:45:002
7244899407,5cyclictest131rcu_preempt22:22:551
72448994032,5cyclictest129329-21sshd22:58:511
72448994026,10cyclictest275-21dbus-daemon23:20:011
7244899402,34cyclictest1-21systemd19:55:011
7245299392,7cyclictest30-21ksoftirqd/220:30:012
7244899399,4cyclictest131rcu_preempt19:28:341
72448993925,11cyclictest23-21ksoftirqd/100:21:241
7244899391,9cyclictest0-21swapper/121:47:351
7244899391,5cyclictest0-21swapper/122:42:531
72448993912,5cyclictest131rcu_preempt00:35:011
7245699381,8cyclictest0-21swapper/319:38:303
72456993812,5cyclictest131rcu_preempt20:25:343
72456993811,5cyclictest131rcu_preempt20:40:583
7244899386,6cyclictest131rcu_preempt20:25:011
72448993829,4cyclictest23-21ksoftirqd/123:58:501
72448993828,7cyclictest23-21ksoftirqd/121:24:291
72448993827,7cyclictest23-21ksoftirqd/119:50:021
72448993813,14cyclictest131rcu_preempt20:29:341
72448993722,10cyclictest275-21dbus-daemon20:35:001
7244899371,5cyclictest131rcu_preempt23:23:581
7244899371,5cyclictest0-21swapper/120:08:091
72448993623,9cyclictest23-21ksoftirqd/120:20:021
72448993623,10cyclictest23-21ksoftirqd/100:27:201
72448993623,10cyclictest23-21ksoftirqd/100:27:191
72448993622,11cyclictest23-21ksoftirqd/120:55:341
72452993523,9cyclictest30-21ksoftirqd/220:50:032
7244899352,5cyclictest131rcu_preempt19:32:341
72448993523,9cyclictest73969-21cron19:40:001
72448993522,8cyclictest23-21ksoftirqd/119:44:341
72448993522,10cyclictest23-21ksoftirqd/119:24:131
72448993522,10cyclictest23-21ksoftirqd/119:24:131
72448993521,10cyclictest3467602-21systemd-journal20:55:011
72456993425,7cyclictest37-21ksoftirqd/319:10:023
72448993421,9cyclictest309-21in:imuxsock20:41:341
72448993421,10cyclictest23-21ksoftirqd/120:00:461
72448993322,9cyclictest23-21ksoftirqd/120:15:011
72448993216,3cyclictest23-21ksoftirqd/119:10:021
72448993121,7cyclictest23-21ksoftirqd/121:02:051
72448993121,7cyclictest23-21ksoftirqd/121:02:051
72452992717,8cyclictest30-21ksoftirqd/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional