You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 22:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Sun Aug 30, 2026 12:45:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
51394991344,25cyclictest37-21ksoftirqd/307:45:013
513909910415,15cyclictest131rcu_preempt12:10:032
51380999995,2cyclictest0-21swapper/009:10:020
51380999176,13cyclictest51374-21cyclictest11:35:030
51380999176,13cyclictest51374-21cyclictest11:35:030
5139499842,64cyclictest90457-21rm10:20:023
51386997629,13cyclictest275-21dbus-daemon12:30:011
5138099741,4cyclictest131rcu_preempt12:36:330
5138099713,38cyclictest131rcu_preempt10:06:000
51394996712,11cyclictest37-21ksoftirqd/310:40:023
5138099677,6cyclictest131rcu_preempt10:45:020
5139499667,9cyclictest37-21ksoftirqd/311:20:003
51394996614,5cyclictest131rcu_preempt10:51:263
5139499655,8cyclictest37-21ksoftirqd/312:00:013
51394996513,11cyclictest37-21ksoftirqd/311:40:013
51394996513,11cyclictest37-21ksoftirqd/311:40:003
51380996532,29cyclictest12-21ksoftirqd/010:18:070
51390996446,7cyclictest43162-21kworker/2:309:40:002
5138099648,5cyclictest131rcu_preempt10:00:500
51380996415,43cyclictest131rcu_preempt09:42:270
5139499636,11cyclictest37-21ksoftirqd/311:25:143
51394996313,5cyclictest131rcu_preempt12:35:023
51394996311,13cyclictest37-21ksoftirqd/309:35:013
5138099639,5cyclictest131rcu_preempt10:49:200
51380996321,38cyclictest12-21ksoftirqd/011:00:020
5139499628,5cyclictest131rcu_preempt12:10:023
5139499626,11cyclictest37-21ksoftirqd/308:15:023
5138099622,6cyclictest131rcu_preempt12:34:190
51380996215,41cyclictest131rcu_preempt09:30:170
51380996210,5cyclictest131rcu_preempt08:10:020
5139499611,13cyclictest92951-21latency_hist10:25:023
5138099619,6cyclictest131rcu_preempt11:55:020
51386996029,20cyclictest0-21swapper/111:25:021
5138099604,7cyclictest12-21ksoftirqd/011:19:590
5139499598,9cyclictest37-21ksoftirqd/308:20:033
5139499598,10cyclictest37-21ksoftirqd/309:25:023
5139499597,8cyclictest37-21ksoftirqd/311:00:013
51394995914,11cyclictest37-21ksoftirqd/311:50:013
51394995913,6cyclictest131rcu_preempt12:37:343
51390995942,13cyclictest1-21systemd07:20:012
5138099597,4cyclictest131rcu_preempt12:17:280
51380995915,14cyclictest131rcu_preempt10:33:280
51380995911,5cyclictest131rcu_preempt09:27:200
51394995811,5cyclictest131rcu_preempt09:30:013
51380995830,13cyclictest106442-21ssh10:53:150
51380995814,38cyclictest131rcu_preempt09:11:240
51380995812,41cyclictest131rcu_preempt09:22:470
5139499578,9cyclictest37-21ksoftirqd/311:23:043
5139499576,8cyclictest37-21ksoftirqd/310:00:023
5139499576,12cyclictest37-21ksoftirqd/311:15:033
5139499576,10cyclictest37-21ksoftirqd/310:42:193
51394995716,6cyclictest131rcu_preempt09:19:503
51394995712,6cyclictest131rcu_preempt09:10:013
51394995710,5cyclictest131rcu_preempt10:01:003
51380995738,13cyclictest275-21dbus-daemon08:05:000
5138099572,9cyclictest12-21ksoftirqd/009:54:580
51380995729,13cyclictest60775-21ssh09:16:370
51380995728,11cyclictest12-21ksoftirqd/009:05:020
51380995722,22cyclictest12-21ksoftirqd/007:50:030
5139499564,8cyclictest37-21ksoftirqd/311:54:593
51394995619,6cyclictest131rcu_preempt11:09:573
51394995613,5cyclictest131rcu_preempt09:35:473
51394995612,9cyclictest131rcu_preempt09:55:023
51390995647,6cyclictest43162-21kworker/2:311:33:582
51390995647,5cyclictest4006042-21kworker/2:209:45:452
51390995635,18cyclictest30-21ksoftirqd/211:20:012
5138099567,8cyclictest12-21ksoftirqd/012:00:010
5138099564,10cyclictest12-21ksoftirqd/012:15:010
5138099564,10cyclictest12-21ksoftirqd/012:15:000
51380995635,16cyclictest275-21dbus-daemon10:15:000
51380995628,13cyclictest152483-21ssh12:29:470
51380995628,13cyclictest132190-21ssh11:46:440
51380995614,33cyclictest16850irq/134-800000011:05:590
5139499557,8cyclictest37-21ksoftirqd/309:48:133
51394995516,6cyclictest131rcu_preempt12:18:153
51394995515,5cyclictest131rcu_preempt12:25:523
51394995514,11cyclictest37-21ksoftirqd/311:45:013
51394995510,5cyclictest131rcu_preempt12:11:323
51394995510,5cyclictest131rcu_preempt12:11:323
51390995547,5cyclictest43162-21kworker/2:310:31:212
51390995546,5cyclictest92893-21kworker/2:111:12:542
51380995527,13cyclictest150165-21ssh12:24:520
5138099551,38cyclictest110045-21ssh11:00:340
5139499549,8cyclictest37-21ksoftirqd/308:25:013
5139499547,9cyclictest37-21ksoftirqd/312:20:033
5139499547,12cyclictest37-21ksoftirqd/308:45:023
5139499546,9cyclictest37-21ksoftirqd/309:14:273
51394995436,13cyclictest3467602-21systemd-journal09:00:013
51394995412,5cyclictest131rcu_preempt10:08:373
51394995411,5cyclictest131rcu_preempt10:32:333
51394995410,5cyclictest131rcu_preempt10:11:253
51394995410,5cyclictest131rcu_preempt07:50:003
51390995446,5cyclictest92893-21kworker/2:111:27:442
51390995446,5cyclictest43162-21kworker/2:310:29:002
51390995446,5cyclictest4006042-21kworker/2:209:10:012
51390995446,4cyclictest92893-21kworker/2:111:56:092
5138099546,6cyclictest131rcu_preempt12:03:470
5138099544,7cyclictest12-21ksoftirqd/011:30:010
5138099544,7cyclictest12-21ksoftirqd/007:35:010
51380995424,10cyclictest12-21ksoftirqd/007:15:010
51380995423,11cyclictest12-21ksoftirqd/010:25:000
51380995414,6cyclictest131rcu_preempt10:30:030
51380995411,6cyclictest131rcu_preempt10:00:010
5139499538,7cyclictest37-21ksoftirqd/307:40:013
5139499536,9cyclictest37-21ksoftirqd/307:59:593
5139499535,9cyclictest37-21ksoftirqd/311:03:403
51394995317,11cyclictest37-21ksoftirqd/309:44:343
51394995315,9cyclictest131rcu_preempt10:45:403
51394995312,5cyclictest131rcu_preempt12:02:333
51394995310,4cyclictest131rcu_preempt10:26:053
5139099538,35cyclictest3467602-21systemd-journal11:25:022
5139099536,43cyclictest150272-21ssh12:25:022
51390995345,5cyclictest92893-21kworker/2:112:38:482
51390995345,5cyclictest43162-21kworker/2:310:50:002
5138099534,8cyclictest121ksoftirqd/011:12:510
51380995343,5cyclictest16950irq/224-800000008:20:000
51380995325,13cyclictest125253-21ssh11:32:180
51380995323,24cyclictest12-21ksoftirqd/007:45:010
51380995323,14cyclictest130693-21ssh11:43:540
51380995315,34cyclictest12-21ksoftirqd/011:23:550
51390995244,5cyclictest92893-21kworker/2:112:35:012
51390995244,5cyclictest4006042-21kworker/2:209:41:492
51390995244,5cyclictest4006042-21kworker/2:207:50:032
5138099529,5cyclictest131rcu_preempt09:45:430
5138099528,5cyclictest131rcu_preempt09:38:490
5139499518,5cyclictest131rcu_preempt07:55:023
5139499518,5cyclictest131rcu_preempt07:55:013
5139499517,5cyclictest131rcu_preempt07:30:013
5139499514,8cyclictest37-21ksoftirqd/307:25:023
51394995116,5cyclictest131rcu_preempt09:05:003
51394995115,5cyclictest131rcu_preempt11:34:393
51390995143,5cyclictest43162-21kworker/2:311:41:152
51390995143,5cyclictest43162-21kworker/2:310:19:582
51390995143,5cyclictest43162-21kworker/2:310:02:142
51380995131,16cyclictest53917-21cut08:00:000
51380995113,5cyclictest131rcu_preempt08:55:020
5139499506,7cyclictest37-21ksoftirqd/308:45:013
5139499503,10cyclictest37-21ksoftirqd/308:55:013
5139499503,10cyclictest37-21ksoftirqd/308:10:013
51394995012,6cyclictest131rcu_preempt07:15:023
5139499501,11cyclictest55737-21munin-plugin-st08:35:003
51390995043,4cyclictest4006042-21kworker/2:209:17:272
51390995042,5cyclictest92893-21kworker/2:112:28:362
51390995042,5cyclictest43162-21kworker/2:311:46:382
51390995042,5cyclictest43162-21kworker/2:311:39:492
51390995042,5cyclictest43162-21kworker/2:311:39:482
51390995042,5cyclictest43162-21kworker/2:310:56:492
51390995042,5cyclictest43162-21kworker/2:310:20:362
51390995041,5cyclictest92893-21kworker/2:112:15:092
51390995041,5cyclictest4006042-21kworker/2:208:09:152
51390995034,14cyclictest3467602-21systemd-journal11:10:002
51380995041,6cyclictest12-21ksoftirqd/008:23:540
51380995040,7cyclictest12-21ksoftirqd/012:05:350
5138099501,8cyclictest12-21ksoftirqd/007:40:010
51390994941,5cyclictest92893-21kworker/2:112:03:052
51390994941,5cyclictest92893-21kworker/2:110:40:542
51390994941,5cyclictest43162-21kworker/2:311:50:162
51390994941,5cyclictest43162-21kworker/2:310:10:492
5138099498,8cyclictest12-21ksoftirqd/008:35:020
51380994916,12cyclictest12-21ksoftirqd/007:25:020
51380994912,33cyclictest16850irq/134-800000010:38:550
5139499489,10cyclictest37-21ksoftirqd/308:05:023
51394994836,9cyclictest37-21ksoftirqd/308:37:143
51390994840,5cyclictest43162-21kworker/2:310:52:482
51390994840,5cyclictest43162-21kworker/2:310:07:052
51390994840,5cyclictest43162-21kworker/2:309:57:142
51390994840,5cyclictest4006042-21kworker/2:209:51:382
51390994840,5cyclictest4006042-21kworker/2:209:30:052
51390994840,5cyclictest4006042-21kworker/2:209:20:492
51390994840,5cyclictest4006042-21kworker/2:207:35:142
51390994839,6cyclictest43162-21kworker/2:310:38:142
51390994839,5cyclictest4006042-21kworker/2:209:10:372
5139499477,7cyclictest37-21ksoftirqd/308:25:143
51394994712,5cyclictest131rcu_preempt07:10:023
51394994712,5cyclictest131rcu_preempt07:10:013
51390994739,5cyclictest4006042-21kworker/2:207:11:472
51390994738,6cyclictest4006042-21kworker/2:208:15:002
5139099473,3cyclictest131rcu_preempt08:35:012
5138699471,16cyclictest92883-21unin-run10:25:011
5138099479,12cyclictest12-21ksoftirqd/008:15:000
5138099474,7cyclictest12-21ksoftirqd/007:29:590
51390994638,5cyclictest92893-21kworker/2:112:10:582
51390994638,5cyclictest92893-21kworker/2:112:10:572
51390994638,5cyclictest43162-21kworker/2:311:01:132
51390994638,5cyclictest4006042-21kworker/2:209:25:172
51390994638,5cyclictest4006042-21kworker/2:209:05:012
5139099462,3cyclictest131rcu_preempt08:40:012
51386994635,6cyclictest57566-21munin-run09:09:591
51386994633,10cyclictest3467602-21systemd-journal09:52:151
51386994629,13cyclictest3467602-21systemd-journal08:50:021
5138099465,9cyclictest12-21ksoftirqd/007:20:000
51380994615,9cyclictest12-21ksoftirqd/008:59:140
5139499456,7cyclictest37-21ksoftirqd/307:20:003
5139099455,3cyclictest131rcu_preempt08:45:002
51390994526,15cyclictest3467602-21systemd-journal07:35:012
51386994528,12cyclictest1-21systemd11:20:011
51386994431,10cyclictest3467602-21systemd-journal10:16:131
51386994431,10cyclictest23-21ksoftirqd/110:15:021
51386994429,12cyclictest57036-21run-parts09:00:011
51386994427,12cyclictest275-21dbus-daemon12:40:011
5138699442,4cyclictest131rcu_preempt11:13:451
5138099445,32cyclictest51382-21cat07:10:020
5138099445,32cyclictest51382-21cat07:10:010
5138099445,23cyclictest19350irq/34-mmc108:45:010
51380994411,10cyclictest12-21ksoftirqd/008:45:040
51390994331,9cyclictest55452-21sshd08:27:132
51386994318,6cyclictest74246-21sh09:45:201
5138699431,17cyclictest310-21in:imklog11:59:091
51390994233,5cyclictest4006042-21kworker/2:208:00:002
51390994228,10cyclictest275-21dbus-daemon08:20:012
51390994215,6cyclictest4006042-21kworker/2:209:00:012
51386994232,7cyclictest23-21ksoftirqd/107:30:031
51386994228,11cyclictest23-21ksoftirqd/111:03:441
51386994228,10cyclictest3467602-21systemd-journal07:25:011
51386994224,14cyclictest275-21dbus-daemon11:25:481
51386994224,13cyclictest131165-21munin-run11:45:011
5138099427,10cyclictest12-21ksoftirqd/007:55:000
5138099427,10cyclictest12-21ksoftirqd/007:55:000
5139499417,9cyclictest37-21ksoftirqd/307:35:013
51390994133,5cyclictest4006042-21kworker/2:207:43:382
5138699418,6cyclictest131rcu_preempt12:10:431
5138699418,6cyclictest131rcu_preempt12:10:421
51386994125,12cyclictest23-21ksoftirqd/109:10:541
51386994122,15cyclictest1-21systemd09:20:001
5138699411,8cyclictest66126-21sshd09:28:151
5138699411,3cyclictest131rcu_preempt07:15:011
5138099418,6cyclictest131rcu_preempt08:40:000
51390994033,5cyclictest4006042-21kworker/2:207:53:522
51390994033,5cyclictest4006042-21kworker/2:207:53:522
51390994028,9cyclictest30-21ksoftirqd/207:30:012
51386994029,9cyclictest23-21ksoftirqd/109:30:571
51386994029,7cyclictest100020-21cron10:40:011
51386994028,9cyclictest56251-21sshd08:44:361
5138699402,5cyclictest131rcu_preempt09:40:021
51386994012,6cyclictest131rcu_preempt10:50:021
5138699399,5cyclictest131rcu_preempt12:16:591
51386993930,5cyclictest53892-21cron07:59:591
51386993928,9cyclictest23-21ksoftirqd/108:25:011
51386993927,9cyclictest23-21ksoftirqd/110:32:331
51386993925,10cyclictest1-21systemd10:30:011
51386993921,13cyclictest275-21dbus-daemon08:35:011
51386993918,9cyclictest0-21swapper/108:40:001
5138699391,3cyclictest131rcu_preempt11:10:021
5138699391,3cyclictest131rcu_preempt07:40:021
5138099392,6cyclictest131rcu_preempt08:30:020
51390993827,8cyclictest30-21ksoftirqd/208:25:012
5138699383,4cyclictest131rcu_preempt10:00:011
51386993829,6cyclictest107835-21ssh10:55:551
51386993826,9cyclictest23-21ksoftirqd/108:10:001
51386993825,9cyclictest275-21dbus-daemon08:50:011
51386993824,10cyclictest23-21ksoftirqd/109:21:001
5138699382,3cyclictest131rcu_preempt10:05:531
5138699382,3cyclictest131rcu_preempt09:41:191
51386993822,12cyclictest309-21in:imuxsock12:05:031
5138699382,11cyclictest52603-21cron07:34:591
5138699381,3cyclictest131rcu_preempt10:45:011
51386993811,5cyclictest131rcu_preempt11:54:591
51386993810,6cyclictest131rcu_preempt11:38:201
51386993810,6cyclictest131rcu_preempt11:38:191
51386993810,6cyclictest131rcu_preempt10:52:591
51390993729,5cyclictest4006042-21kworker/2:207:10:032
51390993729,5cyclictest4006042-21kworker/2:207:10:022
5139099372,18cyclictest54188-21munin-plugin-st08:05:002
51386993726,7cyclictest51821-21cron07:20:011
51386993725,8cyclictest23-21ksoftirqd/112:25:031
51386993724,10cyclictest23-21ksoftirqd/111:47:111
5138699371,6cyclictest0-21swapper/112:30:171
51390993620,12cyclictest30-21ksoftirqd/208:55:012
51390993617,4cyclictest30-21ksoftirqd/207:25:032
51386993629,4cyclictest125397-21sh11:32:441
51386993625,9cyclictest23-21ksoftirqd/108:15:021
51386993522,10cyclictest23-21ksoftirqd/112:01:091
51386993511,5cyclictest131rcu_preempt10:04:491
5138699347,4cyclictest131rcu_preempt09:05:001
5138699344,6cyclictest131rcu_preempt08:20:011
51386993424,8cyclictest23-21ksoftirqd/107:55:031
51386993424,8cyclictest23-21ksoftirqd/107:55:031
51386993423,8cyclictest23-21ksoftirqd/107:45:001
51386993420,10cyclictest309-21in:imuxsock08:30:001
5139099335,4cyclictest131rcu_preempt08:45:152
5138699321,3cyclictest131rcu_preempt07:10:021
5138699321,3cyclictest131rcu_preempt07:10:011
51386993118,10cyclictest1-21systemd07:50:001
5138699311,3cyclictest131rcu_preempt08:01:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional