You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 17:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Mar 15, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1799932996051,6cyclictest1892129-21munin-plugin-st11:35:012
1799935995345,5cyclictest1825186-21munin-plugin-st08:20:013
1799935995345,5cyclictest1825186-21munin-plugin-st08:20:003
1799935995144,5cyclictest1886971-21kworker/u8:2+events_unbound11:29:353
1799932995042,4cyclictest1904272-21idleruntime-cro12:10:002
1799932995042,4cyclictest1904272-21idleruntime-cro12:10:002
1799923995043,5cyclictest1798063-21kworker/u8:1+events_unbound07:34:010
1799923995040,4cyclictest1886997-21sh11:20:000
1799923995039,5cyclictest1895500-21kworker/u8:2+events_unbound11:44:350
1799928994633,9cyclictest231ktimers/108:25:121
1799923994638,4cyclictest1810917-21sendmail07:40:000
1799923994638,4cyclictest1810917-21sendmail07:40:000
1799923994531,10cyclictest121ktimers/009:40:120
1799935994437,5cyclictest1821364-21kworker/u8:1+events_unbound08:39:103
1799932994431,9cyclictest311ktimers/209:20:122
1799935994337,4cyclictest1914643-21kworker/u8:0+events_unbound12:39:423
1799935994337,4cyclictest1835121-21kworker/u8:1+events_unbound08:54:153
1799932994235,4cyclictest1854186-21auditctl09:45:002
1799928994231,8cyclictest1810898-21apt-get07:40:011
1799928994231,8cyclictest1810898-21apt-get07:40:001
1799928994231,7cyclictest1819394-21grep08:00:251
1799935994134,5cyclictest1828385-21kworker/u8:2+events_unbound09:29:193
1799935994129,6cyclictest1816094-21kworker/u8:1+events_unbound07:54:433
1799935994126,9cyclictest131rcu_preempt07:10:223
1799935994034,4cyclictest1842107-21kworker/u8:3+events_unbound09:14:183
1799935994027,4cyclictest131rcu_preempt11:14:563
1799932994033,4cyclictest1835426-21munin-plugin-st08:50:002
1799932994031,6cyclictest1852473-21munin-plugin-st09:40:002
1799935993933,4cyclictest1828385-21kworker/u8:2+events_unbound09:49:213
1799935993933,4cyclictest1809420-21kworker/u8:0+events_unbound07:44:033
1799935993928,7cyclictest1879754-21grep10:55:273
1799935993920,8cyclictest131rcu_preempt10:41:503
1799932993931,5cyclictest1819873-21munin-plugin-st08:05:012
1799928993932,4cyclictest1809151-21apt-key07:35:011
179992399398,7cyclictest131rcu_preempt10:25:130
1799935993832,4cyclictest1900526-21kworker/u8:0+events_unbound12:06:403
1799935993832,4cyclictest1900526-21kworker/u8:0+events_unbound12:06:403
1799935993831,5cyclictest1890044-21kworker/u8:1+events_unbound11:34:363
1799935993827,7cyclictest1838366-21grep08:55:263
1799935993825,9cyclictest1881894-21auditctl11:05:013
1799932993826,9cyclictest311ktimers/212:00:122
1799928993826,9cyclictest1873142-21cron10:40:001
1799935993728,6cyclictest0-21swapper/310:19:593
1799935993727,7cyclictest391ktimers/307:25:123
1799935993724,9cyclictest1846911-21grep09:20:253
1799935993721,9cyclictest131rcu_preempt12:34:213
1799932993731,3cyclictest0-21swapper/208:15:132
1799932993731,3cyclictest0-21swapper/208:15:132
1799932993730,4cyclictest1888718-21auditctl11:25:002
1799928993727,7cyclictest1860529-21unixbench_multi10:00:251
1799923993729,4cyclictest1888313-21grep11:20:230
1799923993727,6cyclictest1803400-21grep07:15:240
1799935993623,5cyclictest131rcu_preempt10:25:243
1799935993621,9cyclictest131rcu_preempt12:14:373
1799935993621,9cyclictest131rcu_preempt12:14:373
1799935993620,9cyclictest131rcu_preempt11:45:223
1799935993618,11cyclictest131rcu_preempt11:50:213
1799932993626,7cyclictest438-21cron10:50:012
1799928993625,6cyclictest0-21swapper/108:15:011
1799923993629,4cyclictest1904046-21kworker/u8:3+events_unbound12:14:410
1799923993629,4cyclictest1904046-21kworker/u8:3+events_unbound12:14:410
1799923993628,4cyclictest1833716-21sh08:45:010
1799935993520,5cyclictest131rcu_preempt09:40:243
1799935993519,9cyclictest131rcu_preempt11:56:233
1799935993518,11cyclictest1869543-21kworker/u8:1+events_unbound11:06:513
1799935993517,10cyclictest131rcu_preempt07:15:143
1799935993515,9cyclictest131rcu_preempt11:21:293
1799932993528,4cyclictest1894028-21auditctl11:40:012
1799932993526,4cyclictest0-21swapper/209:49:212
1799928993527,4cyclictest0-21swapper/108:20:151
1799928993524,6cyclictest0-21swapper/108:55:251
1799928993522,4cyclictest131rcu_preempt11:00:021
1799928993522,3cyclictest131rcu_preempt09:42:271
1799928993514,6cyclictest0-21swapper/110:15:011
1799935993426,4cyclictest0-21swapper/310:50:003
1799935993424,6cyclictest0-21swapper/308:15:003
1799935993423,5cyclictest131rcu_preempt09:05:133
1799935993418,3cyclictest0-21swapper/311:41:483
1799935993417,4cyclictest131rcu_preempt09:50:503
1799935993417,4cyclictest131rcu_preempt09:50:503
1799935993415,4cyclictest131rcu_preempt08:27:443
1799935993413,3cyclictest19950systemd-network07:35:073
1799935993413,3cyclictest19950systemd-network07:35:063
1799932993424,6cyclictest0-21swapper/209:10:012
1799928993427,4cyclictest231ktimers/111:30:161
1799928993425,6cyclictest1907252-21unixbench_singl12:15:251
1799928993423,7cyclictest0-21swapper/109:20:241
1799923993425,6cyclictest1831529-21grep08:35:240
1799923993423,6cyclictest0-21swapper/012:25:260
179993599339,15cyclictest40-21ksoftirqd/309:30:223
1799935993327,4cyclictest1857375-21kworker/u8:1+events_unbound10:10:413
1799935993323,6cyclictest0-21swapper/307:25:003
1799935993322,5cyclictest1828385-21kworker/u8:2+events_unbound09:02:403
1799935993320,7cyclictest1857375-21kworker/u8:1+events_unbound10:04:243
1799935993319,4cyclictest131rcu_preempt12:00:243
1799935993319,4cyclictest131rcu_preempt11:40:013
1799935993316,4cyclictest131rcu_preempt12:25:213
1799935993316,4cyclictest131rcu_preempt07:31:293
1799935993315,5cyclictest131rcu_preempt08:20:123
1799935993315,4cyclictest131rcu_preempt10:09:383
1799928993325,4cyclictest0-21swapper/111:40:161
1799928993319,3cyclictest131rcu_preempt07:55:171
1799923993326,5cyclictest1873018-21kworker/u8:2+events_unbound10:49:290
1799923993324,6cyclictest0-21swapper/012:15:250
1799923993323,7cyclictest1848646-21grep09:25:250
1799923993321,8cyclictest1889938-21grep11:25:260
1799935993226,4cyclictest1809420-21kworker/u8:0+events_unbound08:04:073
1799935993222,7cyclictest391ktimers/308:05:183
1799935993220,9cyclictest391ktimers/307:55:143
1799935993216,4cyclictest131rcu_preempt09:17:533
1799935993215,5cyclictest131rcu_preempt12:15:173
1799935993214,5cyclictest131rcu_preempt11:15:333
1799935993212,11cyclictest1828385-21kworker/u8:2-events_power_efficient08:47:043
1799935993210,11cyclictest40-21ksoftirqd/312:20:163
1799932993225,3cyclictest0-21swapper/209:25:262
1799928993224,5cyclictest1885301-21auditctl11:15:011
1799928993224,4cyclictest0-21swapper/110:24:251
1799928993224,4cyclictest0-21swapper/110:15:261
1799928993223,4cyclictest0-21swapper/111:20:231
1799928993210,8cyclictest1912369-21date12:30:261
1799923993225,4cyclictest0-21swapper/008:05:220
1799923993225,3cyclictest0-21swapper/011:00:010
179993599319,10cyclictest1871053-21users10:30:263
179993599317,13cyclictest40-21ksoftirqd/309:35:133
179993599317,12cyclictest40-21ksoftirqd/310:00:013
1799935993124,4cyclictest1873162-21idleruntime-cro10:40:013
1799935993124,4cyclictest0-21swapper/308:30:143
1799935993117,8cyclictest1812572-21kworker/u8:3+events_unbound07:47:523
1799935993113,5cyclictest131rcu_preempt10:50:243
1799935993111,11cyclictest131rcu_preempt08:40:163
1799932993125,3cyclictest1881896-21kthreadd11:05:002
1799932993124,4cyclictest1805110-21unixbench_multi07:20:242
1799932993124,4cyclictest0-21swapper/210:00:152
1799932993123,4cyclictest0-21swapper/208:55:262
1799932993123,4cyclictest0-21swapper/207:45:252
1799928993122,6cyclictest1801140-21unixbench_singl07:10:271
179992399310,5cyclictest131rcu_preempt11:30:130
1799935993022,4cyclictest0-21swapper/310:20:243
1799932993024,3cyclictest0-21swapper/210:40:012
1799932993022,4cyclictest0-21swapper/212:10:152
1799932993022,4cyclictest0-21swapper/212:10:152
1799932993017,9cyclictest204-21dbus-daemon11:49:362
179992899307,5cyclictest24-21ksoftirqd/107:50:231
179992899307,5cyclictest221rcuc/110:25:261
179992899306,7cyclictest24-21ksoftirqd/107:40:241
179992899306,6cyclictest24-21ksoftirqd/111:25:211
179992899306,12cyclictest24-21ksoftirqd/108:50:001
179992899304,6cyclictest24-21ksoftirqd/109:25:251
1799928993020,7cyclictest231ktimers/109:05:211
1799928993020,5cyclictest0-21swapper/111:55:001
1799928993016,3cyclictest131rcu_preempt07:19:591
1799928993015,4cyclictest131rcu_preempt07:20:211
1799928993012,5cyclictest131rcu_preempt11:45:121
1799923993024,4cyclictest1869543-21kworker/u8:1+events_unbound10:36:430
1799923993023,4cyclictest13550irq/42-30be0000.ethernet12:20:240
1799932992921,5cyclictest0-21swapper/207:55:002
1799932992921,4cyclictest0-21swapper/212:35:242
1799932992919,6cyclictest1878003-21grep10:50:252
179992899297,7cyclictest24-21ksoftirqd/112:10:001
179992899297,7cyclictest24-21ksoftirqd/112:10:001
179992899297,6cyclictest221rcuc/110:05:171
179992899296,8cyclictest24-21ksoftirqd/109:10:241
179992899296,7cyclictest24-21ksoftirqd/111:00:171
179992899295,12cyclictest0-21swapper/109:15:171
179992899294,7cyclictest24-21ksoftirqd/111:59:431
1799928992918,7cyclictest0-21swapper/108:50:251
179992399292,5cyclictest131rcu_preempt09:10:120
1799923992923,3cyclictest1814591-21runrttasks07:50:010
1799932992822,3cyclictest0-21swapper/207:45:012
1799932992819,5cyclictest0-21swapper/208:20:252
1799932992818,5cyclictest1803417-21grep07:15:252
179992899286,7cyclictest24-21ksoftirqd/107:25:221
179992899285,7cyclictest24-21ksoftirqd/108:40:011
179992899285,6cyclictest0-21swapper/110:30:251
179992899284,7cyclictest24-21ksoftirqd/111:19:141
179992899284,5cyclictest24-21ksoftirqd/108:15:271
179992899284,5cyclictest24-21ksoftirqd/108:15:261
179992899283,8cyclictest24-21ksoftirqd/109:58:221
179992899282,8cyclictest24-21ksoftirqd/112:00:121
1799928992819,7cyclictest231ktimers/110:50:331
1799928992818,7cyclictest231ktimers/112:25:231
1799928992815,4cyclictest131rcu_preempt12:10:141
1799928992815,4cyclictest131rcu_preempt12:10:131
1799928992810,5cyclictest131rcu_preempt10:42:371
179992399282,6cyclictest131rcu_preempt09:35:120
1799923992821,3cyclictest0-21swapper/010:50:250
1799923992820,4cyclictest0-21swapper/010:10:230
1799923992817,8cyclictest1834893-21grep08:45:240
179992399281,3cyclictest131rcu_preempt09:54:200
179992399281,3cyclictest131rcu_preempt09:54:200
179992399280,5cyclictest131rcu_preempt12:30:130
1799932992721,3cyclictest1885300-21cron11:15:012
1799932992720,3cyclictest0-21swapper/210:10:222
1799932992719,4cyclictest0-21swapper/210:25:262
179993299271,7cyclictest1895285-21unixbench_multi11:40:262
1799932992717,6cyclictest0-21swapper/208:05:262
179992899279,9cyclictest131rcu_preempt09:00:121
179992899275,7cyclictest24-21ksoftirqd/111:05:131
179992899273,6cyclictest24-21ksoftirqd/109:50:241
179992899273,6cyclictest24-21ksoftirqd/109:50:241
179992899273,5cyclictest24-21ksoftirqd/112:35:181
179992899273,5cyclictest24-21ksoftirqd/109:45:231
1799928992722,3cyclictest1909498-21apt-key12:25:001
1799928992718,6cyclictest0-21swapper/111:40:001
1799928992716,4cyclictest131rcu_preempt09:36:081
1799928992714,5cyclictest131rcu_preempt10:45:191
1799928992712,4cyclictest0-21swapper/108:40:121
1799923992721,4cyclictest0-21swapper/012:35:110
1799923992720,4cyclictest1875046-21latency_hist10:45:020
1799923992719,4cyclictest0-21swapper/008:20:010
1799923992719,4cyclictest0-21swapper/008:20:010
1799923992716,7cyclictest204-21dbus-daemon07:23:590
179992399271,23cyclictest1838935-21latency_hist09:00:020
1799932992620,3cyclictest0-21swapper/212:30:232
1799932992619,4cyclictest0-21swapper/210:55:162
1799932992615,7cyclictest0-21swapper/211:50:242
179992399267,14cyclictest0-21swapper/008:15:000
1799923992619,3cyclictest0-21swapper/009:05:250
1799923992617,7cyclictest1866324-21latency_hist10:20:000
1799923992614,8cyclictest1862708-21idleruntime-cro10:10:000
1799932992519,4cyclictest1887138-21latency_hist11:20:012
1799932992518,5cyclictest1806835-21unixbench_multi07:25:242
1799932992517,4cyclictest0-21swapper/209:15:262
179992899254,12cyclictest24-21ksoftirqd/108:05:241
179992899251,5cyclictest24-21ksoftirqd/109:32:341
179992899251,5cyclictest24-21ksoftirqd/108:30:241
179992399256,7cyclictest1843838-21kworker/u8:1+events_unbound09:24:180
1799923992519,4cyclictest1902294-21kworker/u8:1+events_unbound12:04:080
1799923992519,4cyclictest1873018-21kworker/u8:2+events_unbound11:09:310
1799923992519,4cyclictest1828385-21kworker/u8:2+events_unbound09:48:550
1799923992519,4cyclictest1821364-21kworker/u8:1+events_unbound08:20:240
1799923992519,4cyclictest1785427-21kworker/u8:2+events_unbound07:10:420
1799923992519,3cyclictest0-21swapper/007:25:250
1799923992517,6cyclictest1867727-21kworker/u8:0+events_unbound10:24:480
179992399251,5cyclictest1840535-21sh09:05:000
179992399251,21cyclictest1896071-21ls11:45:110
1799932992418,3cyclictest0-21swapper/209:30:242
1799932992417,4cyclictest1909389-21auditctl12:25:002
1799932992417,4cyclictest1808508-21grep07:30:262
1799932992415,7cyclictest311ktimers/210:15:072
1799932992415,6cyclictest0-21swapper/209:59:592
1799923992418,4cyclictest1809420-21kworker/u8:0+events_unbound08:01:290
1799923992418,3cyclictest13550irq/42-30be0000.ethernet07:55:180
1799923992417,3cyclictest0-21swapper/011:55:260
1799923992416,5cyclictest0-21swapper/011:40:000
1799923992416,4cyclictest438-21cron10:05:000
1799923992416,4cyclictest0-21swapper/011:10:260
1799923992414,7cyclictest11-21ksoftirqd/009:30:220
179992399241,19cyclictest0-21swapper/011:52:560
179992399241,19cyclictest0-21swapper/008:30:060
179992399241,12cyclictest0-21swapper/007:54:010
1799932992318,3cyclictest1873018-21kworker/u8:2-events_freezable_power_10:40:162
1799932992317,3cyclictest645-21runrttasks08:10:232
1799932992317,3cyclictest0-21swapper/212:20:002
1799932992317,3cyclictest0-21swapper/209:50:152
1799932992317,3cyclictest0-21swapper/209:50:152
1799932992317,3cyclictest0-21swapper/208:50:122
1799932992317,3cyclictest0-21swapper/208:30:222
1799932992317,3cyclictest0-21swapper/207:10:182
1799932992316,4cyclictest0-21swapper/208:40:242
1799932992316,3cyclictest0-21swapper/208:40:012
1799932992315,4cyclictest0-21swapper/210:30:252
1799923992317,4cyclictest1869543-21kworker/u8:1+events_unbound11:01:280
1799923992317,3cyclictest0-21swapper/010:31:070
1799923992316,3cyclictest0-21swapper/008:54:340
1799923992316,3cyclictest0-21swapper/007:43:010
179992399231,3cyclictest131rcu_preempt10:00:010
179993299229,9cyclictest1867572-21grep10:20:252
1799932992216,3cyclictest0-21swapper/211:25:172
1799932992215,4cyclictest1899853-21missed_timers11:55:202
1799932992214,5cyclictest1817724-21grep07:55:272
1799932992212,6cyclictest0-21swapper/209:10:202
179992399221,9cyclictest1827127-21apt08:25:110
1799923992216,3cyclictest13550irq/42-30be0000.ethernet12:05:230
1799923992216,3cyclictest13550irq/42-30be0000.ethernet12:05:230
1799932992014,4cyclictest2273479-1kworker/2:2H+kblockd07:35:132
1799932992014,4cyclictest2273479-1kworker/2:2H+kblockd07:35:132
1799932992014,3cyclictest0-21swapper/210:05:242
1799932992011,6cyclictest1882326-21tune2fs11:05:142
1799932991912,5cyclictest311ktimers/209:00:142
1799932991812,4cyclictest311ktimers/212:27:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional