You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 14:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Fri Jul 31, 2026 00:45:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
481361999085,3cyclictest0-21swapper/000:25:020
481361997613,54cyclictest0-21swapper/023:45:000
481361997571,2cyclictest0-21swapper/021:45:020
481361997510,42cyclictest131rcu_preempt21:50:010
481361997470,2cyclictest0-21swapper/021:55:010
48136199703,28cyclictest12-21ksoftirqd/023:00:010
48137499692,60cyclictest492478-21ssh21:20:023
481361996762,2cyclictest0-21swapper/000:10:040
48136199657,4cyclictest131rcu_preempt23:49:450
481371996416,5cyclictest131rcu_preempt21:20:012
481371996413,6cyclictest131rcu_preempt22:25:012
481361996411,21cyclictest131rcu_preempt23:30:020
481361996336,5cyclictest131rcu_preempt22:32:420
48137199629,6cyclictest131rcu_preempt00:40:032
48137199622,8cyclictest30-21ksoftirqd/223:55:012
48137199622,8cyclictest30-21ksoftirqd/223:46:062
481361996231,15cyclictest587355-21ssh00:40:010
48136199616,8cyclictest12-21ksoftirqd/023:05:000
481361996131,15cyclictest520021-21ssh22:18:090
481364996037,6cyclictest131rcu_preempt00:05:021
48136199604,11cyclictest12-21ksoftirqd/021:25:000
481361996015,6cyclictest121ksoftirqd/023:21:360
481361996011,5cyclictest131rcu_preempt00:35:010
481361995915,39cyclictest53784750kworker/u8:423:35:010
48136199588,7cyclictest12-21ksoftirqd/022:48:230
48136199583,8cyclictest121ksoftirqd/021:33:120
48136199583,20cyclictest568263-40mandb00:00:010
481361995816,14cyclictest12-21ksoftirqd/021:40:010
481361995816,14cyclictest12-21ksoftirqd/021:40:000
481361995814,5cyclictest131rcu_preempt22:23:170
481361995811,4cyclictest131rcu_preempt22:43:290
48136199575,9cyclictest131rcu_preempt22:00:530
481361995718,9cyclictest12-21ksoftirqd/022:39:360
481361995713,6cyclictest131rcu_preempt23:16:350
481361995712,5cyclictest131rcu_preempt00:27:570
481361995711,4cyclictest131rcu_preempt23:51:510
481361995710,6cyclictest131rcu_preempt00:10:020
481374995620,18cyclictest37-21ksoftirqd/319:30:033
481371995641,7cyclictest486012-21kworker/2:123:02:282
481371995610,6cyclictest131rcu_preempt00:20:002
48136199565,10cyclictest12-21ksoftirqd/023:10:010
48136199561,14cyclictest12-21ksoftirqd/019:35:020
481371995539,7cyclictest486012-21kworker/2:121:51:202
48136199557,9cyclictest12-21ksoftirqd/019:15:030
48136199555,11cyclictest12-21ksoftirqd/000:00:040
48136199555,10cyclictest12-21ksoftirqd/020:20:020
481361995518,32cyclictest16850irq/134-800000022:12:300
481361995511,6cyclictest131rcu_preempt22:25:110
48137199544,8cyclictest30-21ksoftirqd/200:00:022
48137199541,8cyclictest540012-21ssh23:00:012
481371995410,6cyclictest131rcu_preempt00:15:012
48136199548,11cyclictest12-21ksoftirqd/022:10:020
48136199547,10cyclictest12-21ksoftirqd/000:15:380
481361995419,31cyclictest16850irq/134-800000022:52:530
481361995418,31cyclictest16850irq/134-800000021:55:350
481361995414,5cyclictest131rcu_preempt21:13:430
481361995413,5cyclictest131rcu_preempt21:15:200
481361995410,6cyclictest131rcu_preempt23:11:170
481361995410,5cyclictest131rcu_preempt20:35:010
48137199538,5cyclictest131rcu_preempt00:31:522
48137199536,8cyclictest30-21ksoftirqd/222:00:212
48137199534,10cyclictest30-21ksoftirqd/221:40:012
48137199534,10cyclictest30-21ksoftirqd/221:40:012
481371995339,6cyclictest483408-21kworker/2:222:25:412
481371995333,14cyclictest1-21systemd00:30:012
481371995313,5cyclictest131rcu_preempt23:45:022
481364995326,6cyclictest23-21ksoftirqd/122:36:331
48136199534,10cyclictest12-21ksoftirqd/019:55:020
481361995317,32cyclictest16850irq/134-800000023:35:160
48137199529,5cyclictest131rcu_preempt21:55:322
48137199528,5cyclictest131rcu_preempt21:45:012
48137199526,11cyclictest30-21ksoftirqd/219:45:012
481371995243,6cyclictest483408-21kworker/2:221:14:032
481371995211,5cyclictest131rcu_preempt23:39:212
48136199524,7cyclictest12-21ksoftirqd/020:05:020
481361995225,12cyclictest495063-21ssh21:25:280
48137199517,10cyclictest30-21ksoftirqd/222:10:122
48137199516,8cyclictest30-21ksoftirqd/220:00:002
481371995143,5cyclictest537606-21kworker/2:323:19:042
481371995143,5cyclictest537606-21kworker/2:300:00:092
481371995143,5cyclictest486012-21kworker/2:122:05:302
481371995143,5cyclictest486012-21kworker/2:121:46:222
481371995142,6cyclictest537606-21kworker/2:323:23:322
481371995142,6cyclictest486012-21kworker/2:122:53:042
48137199511,10cyclictest499322-21cron21:35:002
48136499511,8cyclictest0-21swapper/119:40:011
48136199515,9cyclictest12-21ksoftirqd/020:55:000
48136199513,9cyclictest12-21ksoftirqd/019:45:000
481361995111,6cyclictest131rcu_preempt20:30:010
481361995111,5cyclictest131rcu_preempt20:40:020
481361995111,5cyclictest131rcu_preempt20:15:000
48137199505,15cyclictest30-21ksoftirqd/222:38:552
481371995042,5cyclictest537606-21kworker/2:300:09:232
481371995042,5cyclictest486012-21kworker/2:123:11:262
481371995042,5cyclictest486012-21kworker/2:123:08:112
481371995042,5cyclictest483408-21kworker/2:222:41:152
481371995041,6cyclictest486012-21kworker/2:120:51:502
481371995041,5cyclictest467057-21kworker/2:219:28:372
481371995040,6cyclictest482910-21kworker/2:119:48:592
481371995039,7cyclictest483408-21kworker/2:220:16:312
481371995011,7cyclictest131rcu_preempt21:25:212
48136499509,6cyclictest131rcu_preempt23:06:491
48136499507,6cyclictest131rcu_preempt22:05:001
48136499503,43cyclictest221rcuc/123:40:021
48136499502,3cyclictest131rcu_preempt19:45:001
48136199507,12cyclictest12-21ksoftirqd/019:50:010
48136199505,11cyclictest12-21ksoftirqd/019:40:010
481361995038,8cyclictest481369-21latency_hist19:10:020
481361995016,10cyclictest12-21ksoftirqd/019:11:110
481374994929,14cyclictest511358-21systemctl22:00:003
48137499492,3cyclictest131rcu_preempt22:20:003
481371994942,4cyclictest486012-21kworker/2:122:47:342
481371994941,5cyclictest486012-21kworker/2:123:32:352
481371994941,5cyclictest486012-21kworker/2:122:32:102
481371994941,5cyclictest486012-21kworker/2:122:15:222
481371994941,5cyclictest486012-21kworker/2:121:05:262
481371994941,5cyclictest483408-21kworker/2:221:22:462
481371994940,6cyclictest537606-21kworker/2:300:21:362
481364994924,4cyclictest23-21ksoftirqd/100:19:581
48136499492,3cyclictest131rcu_preempt22:53:041
48136499491,7cyclictest492274-21modprobe21:20:001
481364994914,5cyclictest131rcu_preempt22:20:021
48136199494,8cyclictest12-21ksoftirqd/019:30:010
481361994932,13cyclictest3467602-21systemd-journal21:10:010
48136199492,8cyclictest12-21ksoftirqd/020:00:000
481361994912,4cyclictest131rcu_preempt20:09:120
481374994818,15cyclictest37-21ksoftirqd/322:58:273
48137199484,10cyclictest30-21ksoftirqd/219:20:002
481371994840,5cyclictest537606-21kworker/2:323:25:032
481371994840,5cyclictest486012-21kworker/2:120:49:252
481371994840,5cyclictest486012-21kworker/2:120:44:502
481371994840,5cyclictest486012-21kworker/2:120:44:492
481371994840,5cyclictest483408-21kworker/2:220:10:032
481371994840,5cyclictest482910-21kworker/2:120:05:022
481371994839,5cyclictest483408-21kworker/2:220:34:412
481371994829,15cyclictest3467602-21systemd-journal21:05:002
481371994810,6cyclictest131rcu_preempt20:30:022
48136499488,25cyclictest221rcuc/119:30:021
48136499483,3cyclictest131rcu_preempt23:30:001
48136499481,9cyclictest483903-21systemctl20:00:001
481364994810,6cyclictest131rcu_preempt23:05:001
48136199486,5cyclictest131rcu_preempt19:20:110
48136199486,5cyclictest131rcu_preempt19:20:110
481361994812,5cyclictest131rcu_preempt20:45:010
481361994812,5cyclictest131rcu_preempt20:45:010
481361994812,10cyclictest12-21ksoftirqd/020:25:000
481371994740,4cyclictest482910-21kworker/2:119:51:012
481371994739,5cyclictest483408-21kworker/2:220:20:062
481371994739,5cyclictest482910-21kworker/2:120:00:512
481371994739,5cyclictest482115-21kworker/2:319:30:272
481371994739,5cyclictest465198-21kworker/2:119:21:362
481371994739,5cyclictest465198-21kworker/2:119:21:352
481371994739,5cyclictest465198-21kworker/2:119:13:342
481371994738,6cyclictest482115-21kworker/2:319:37:282
481371994737,7cyclictest483408-21kworker/2:220:35:402
48136499477,6cyclictest131rcu_preempt00:00:021
481364994721,4cyclictest23-21ksoftirqd/122:25:031
48136499471,4cyclictest131rcu_preempt21:34:561
48136499471,3cyclictest131rcu_preempt22:34:131
48136199474,9cyclictest12-21ksoftirqd/021:05:000
481374994636,8cyclictest37-21ksoftirqd/300:25:023
481374994620,16cyclictest37-21ksoftirqd/322:34:413
48137499461,3cyclictest131rcu_preempt00:00:003
481374994611,6cyclictest131rcu_preempt22:23:003
481371994638,5cyclictest483408-21kworker/2:220:55:042
481371994638,5cyclictest483408-21kworker/2:220:55:032
48136499466,5cyclictest131rcu_preempt22:10:031
48136499463,3cyclictest131rcu_preempt23:44:461
48136499461,4cyclictest131rcu_preempt23:19:061
481364994610,6cyclictest131rcu_preempt22:00:011
481374994531,10cyclictest3467602-21systemd-journal23:30:123
48137499452,12cyclictest486182-21wc20:40:023
481371994510,5cyclictest131rcu_preempt19:10:022
48136499458,5cyclictest131rcu_preempt21:40:031
48136499458,5cyclictest131rcu_preempt21:40:021
481364994531,12cyclictest23-21ksoftirqd/122:44:521
48136499452,3cyclictest131rcu_preempt00:37:351
481364994520,18cyclictest275-21dbus-daemon21:10:011
48136499451,3cyclictest131rcu_preempt22:58:401
48136499451,3cyclictest131rcu_preempt22:49:031
481374994427,13cyclictest37-21ksoftirqd/323:15:413
48137499441,6cyclictest0-21swapper/322:40:013
481374994414,17cyclictest0-21swapper/300:28:573
48137499441,3cyclictest131rcu_preempt00:40:003
48136499447,6cyclictest131rcu_preempt19:50:021
48136499447,5cyclictest131rcu_preempt23:50:481
48136499443,3cyclictest131rcu_preempt20:25:001
48136499442,3cyclictest131rcu_preempt19:10:031
48136499442,3cyclictest131rcu_preempt00:24:551
481364994419,6cyclictest23-21ksoftirqd/121:54:391
481364994415,8cyclictest556520-21ssh23:35:031
48136499441,4cyclictest131rcu_preempt20:30:031
48136499441,3cyclictest131rcu_preempt21:50:011
48136499441,3cyclictest131rcu_preempt21:45:011
48136199449,5cyclictest131rcu_preempt20:50:020
481361994437,4cyclictest16850irq/134-800000021:00:000
481361994437,4cyclictest16850irq/134-800000021:00:000
481374994328,12cyclictest37-21ksoftirqd/322:29:573
481374994313,11cyclictest37-21ksoftirqd/322:15:013
48136499433,3cyclictest131rcu_preempt20:10:021
481364994328,11cyclictest275-21dbus-daemon20:35:001
48136499431,3cyclictest131rcu_preempt21:11:421
48136499431,3cyclictest131rcu_preempt00:09:531
48137499424,3cyclictest131rcu_preempt23:47:563
48137499422,3cyclictest131rcu_preempt21:45:003
48137499422,3cyclictest131rcu_preempt20:00:013
481374994218,16cyclictest0-21swapper/300:09:573
481374994216,8cyclictest486664-21cat20:50:013
481374994215,9cyclictest37-21ksoftirqd/320:30:023
48136499423,3cyclictest131rcu_preempt21:27:571
481364994231,7cyclictest1-21systemd23:25:011
48136499422,3cyclictest131rcu_preempt23:46:381
48136499421,3cyclictest131rcu_preempt23:11:261
48137499413,3cyclictest131rcu_preempt23:22:573
48137499413,3cyclictest131rcu_preempt00:35:013
481374994127,9cyclictest1-21systemd19:40:013
481374994126,9cyclictest537576-21ssh22:55:003
48137499412,3cyclictest131rcu_preempt22:49:463
48137499412,3cyclictest131rcu_preempt00:16:003
481374994121,12cyclictest150-21pr/ttyS200:12:153
48137499411,5cyclictest131rcu_preempt19:55:023
48137499411,4cyclictest131rcu_preempt23:27:563
48137499411,3cyclictest131rcu_preempt22:10:013
48136499418,6cyclictest131rcu_preempt20:15:011
481364994128,8cyclictest309-21in:imuxsock00:25:121
481364994127,10cyclictest481889-21sed19:20:011
481364994125,5cyclictest516681-21sh22:10:511
481364994124,4cyclictest23-21ksoftirqd/119:55:011
48137499402,6cyclictest481832-21munin-run19:20:003
48137499402,4cyclictest131rcu_preempt21:50:003
48137499402,3cyclictest131rcu_preempt23:45:003
48137499402,10cyclictest131rcu_preempt23:01:093
48137499401,3cyclictest131rcu_preempt23:36:013
48137499401,3cyclictest131rcu_preempt22:00:223
48137499401,3cyclictest131rcu_preempt21:13:303
48136499403,3cyclictest131rcu_preempt22:29:091
481364994028,9cyclictest3467602-21systemd-journal21:20:121
48136499402,3cyclictest131rcu_preempt00:12:271
481364994019,5cyclictest23-21ksoftirqd/119:25:021
481364994019,5cyclictest23-21ksoftirqd/119:25:011
481374993927,8cyclictest37-21ksoftirqd/320:45:003
481374993927,8cyclictest37-21ksoftirqd/320:45:003
481374993927,10cyclictest37-21ksoftirqd/321:32:383
481374993926,4cyclictest0-21swapper/320:10:023
481374993924,10cyclictest275-21dbus-daemon21:05:003
48137499392,3cyclictest131rcu_preempt23:51:183
48137499392,3cyclictest131rcu_preempt23:06:053
481374993922,13cyclictest3467602-21systemd-journal22:45:003
481374993919,8cyclictest547104-21kworker/3:100:04:483
48137499391,3cyclictest131rcu_preempt21:37:053
48137499391,3cyclictest131rcu_preempt21:37:043
48137499391,3cyclictest131rcu_preempt21:26:273
48136499397,6cyclictest131rcu_preempt00:30:041
481364993925,11cyclictest275-21dbus-daemon20:40:001
481364993922,4cyclictest23-21ksoftirqd/120:05:011
481364993922,3cyclictest23-21ksoftirqd/120:50:001
48137499383,3cyclictest131rcu_preempt21:21:353
481374993825,8cyclictest487729-21cat21:10:023
481374993819,13cyclictest3467602-21systemd-journal21:00:013
481374993819,13cyclictest3467602-21systemd-journal21:00:003
48137499381,3cyclictest131rcu_preempt23:11:003
48137499381,3cyclictest131rcu_preempt21:51:453
48137499381,3cyclictest131rcu_preempt20:15:023
48137499381,3cyclictest131rcu_preempt19:50:003
481364993825,9cyclictest3467602-21systemd-journal19:15:011
481364993824,11cyclictest3467602-21systemd-journal20:55:021
481364993823,10cyclictest275-21dbus-daemon21:05:011
481374993718,13cyclictest364-21snmpd20:15:243
481364993723,10cyclictest275-21dbus-daemon20:45:021
481364993723,10cyclictest275-21dbus-daemon20:45:011
48137499363,11cyclictest131rcu_preempt20:34:593
481374993622,11cyclictest482635-21cat19:35:013
48137499362,12cyclictest131rcu_preempt19:45:023
481374993617,13cyclictest275-21dbus-daemon20:55:013
481364993625,8cyclictest1-21systemd21:00:011
481364993625,8cyclictest1-21systemd21:00:011
481364993619,4cyclictest23-21ksoftirqd/119:30:021
481364993617,7cyclictest131rcu_preempt20:20:001
481374993527,6cyclictest37-21ksoftirqd/319:20:163
481374993527,6cyclictest37-21ksoftirqd/319:20:163
481374993514,9cyclictest37-21ksoftirqd/319:10:023
48137499341,5cyclictest131rcu_preempt19:15:023
48137499341,3cyclictest131rcu_preempt20:20:033
481374993219,11cyclictest37-21ksoftirqd/320:05:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional