You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 04:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Tue May 19, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1541809995345,6cyclictest1576342-21kworker/u8:0+events_unbound20:52:072
1541809995336,11cyclictest311ktimers/220:05:122
1541809995242,7cyclictest1543567-21munin-plugin-st19:15:012
1541807995042,5cyclictest1639978-21unixbench_multi23:50:260
1541810994939,7cyclictest1628101-21sendmail23:20:003
1541809994943,4cyclictest1638450-21kworker/u8:2+events_unbound23:47:362
1541807994919,4cyclictest131rcu_preempt22:45:120
1541810994536,4cyclictest0-21swapper/320:20:133
1541809994539,4cyclictest1638450-21kworker/u8:2+events_unbound23:57:382
1541809994537,6cyclictest1636517-21kworker/u8:1+events_unbound00:02:392
1541807994515,6cyclictest131rcu_preempt00:30:110
1541809994419,10cyclictest131rcu_preempt20:43:262
1541807994436,4cyclictest1642383-21idleruntime-cro00:00:010
1541807994334,5cyclictest1649834-21sendmail00:20:010
1541810994232,7cyclictest1564906-21fschecks_count20:15:143
1541810994228,10cyclictest1625950-21grep23:10:263
1541810994222,13cyclictest131rcu_preempt19:30:193
1541807994230,6cyclictest0-21swapper/021:15:000
1541810994121,6cyclictest131rcu_preempt22:55:013
1541809994135,4cyclictest1597084-21kworker/u8:1+events_unbound22:02:192
1541807994134,5cyclictest1450230-21kworker/u8:2+events_unbound19:26:580
1541807994132,6cyclictest1552987-21fschecks_count19:40:180
1541807994132,6cyclictest1552987-21fschecks_count19:40:180
1541810994029,7cyclictest1583056-21grep21:05:263
1541809994022,11cyclictest131rcu_preempt21:40:212
1541808994032,4cyclictest1611036-21ls22:30:001
1541810993931,4cyclictest0-21swapper/321:25:153
1541810993920,11cyclictest131rcu_preempt19:35:373
1541810993920,11cyclictest131rcu_preempt19:35:363
1541810993918,18cyclictest391ktimers/300:26:403
1541809993933,4cyclictest1614293-21kworker/u8:3+events_unbound23:12:282
1541809993933,4cyclictest1563054-21kworker/u8:3+events_unbound20:27:042
1541807993927,6cyclictest0-21swapper/023:15:010
1541807993919,11cyclictest131rcu_preempt21:50:110
154180999383,6cyclictest32-21ksoftirqd/221:50:102
1541809993832,4cyclictest1543123-21kworker/u8:3+events_unbound19:21:582
1541809993831,4cyclictest1541805-21cyclictest20:50:022
154180799389,5cyclictest131rcu_preempt22:00:140
1541807993832,4cyclictest1612369-21kworker/u8:1+events_unbound22:37:280
1541807993831,4cyclictest0-21swapper/023:20:000
1541807993825,8cyclictest0-21swapper/020:55:260
1541810993727,7cyclictest1574371-21grep20:40:253
1541809993731,4cyclictest1645746-21kworker/u8:2+events_unbound00:07:412
1541809993730,4cyclictest0-21swapper/223:20:002
1541809993727,7cyclictest1581810-21sh21:05:012
1541809993727,7cyclictest0-21swapper/219:20:002
1541809993727,7cyclictest0-21swapper/219:20:002
1541809993716,9cyclictest131rcu_preempt19:50:322
1541809993716,5cyclictest131rcu_preempt00:23:232
1541808993730,5cyclictest1607617-21munin-plugin-st22:20:011
1541807993726,6cyclictest0-21swapper/000:05:260
1541810993629,4cyclictest1576488-21latency_hist20:50:003
1541810993625,8cyclictest1630008-21debian-sa123:25:013
1541810993624,8cyclictest391ktimers/319:15:043
1541810993624,8cyclictest391ktimers/319:15:043
1541810993620,5cyclictest131rcu_preempt22:45:263
1541810993619,9cyclictest131rcu_preempt20:12:243
1541810993619,3cyclictest131rcu_preempt22:15:023
1541809993630,4cyclictest1583175-21kworker/u8:1+events_unbound21:12:112
1541809993629,5cyclictest1583175-21kworker/u8:1+events_unbound21:08:412
1541809993628,5cyclictest1556006-21cron19:50:002
1541809993623,5cyclictest131rcu_preempt22:45:142
1541809993621,4cyclictest131rcu_preempt23:30:332
1541809993620,5cyclictest131rcu_preempt22:53:012
1541809993618,4cyclictest131rcu_preempt20:21:402
1541807993626,6cyclictest0-21swapper/019:10:250
1541807993617,6cyclictest1649678-21kworker/u8:0+events_unbound00:22:000
1541807993614,10cyclictest131rcu_preempt21:35:230
1541810993525,4cyclictest131rcu_preempt21:57:073
1541809993529,4cyclictest645-21runrttasks21:20:102
1541809993526,5cyclictest301rcuc/220:40:002
1541809993520,5cyclictest131rcu_preempt23:25:572
1541809993519,5cyclictest131rcu_preempt20:05:022
1541809993516,5cyclictest131rcu_preempt23:00:012
1541809993515,5cyclictest131rcu_preempt21:35:232
1541809993514,5cyclictest131rcu_preempt19:35:232
1541809993514,5cyclictest131rcu_preempt19:35:222
1541808993527,4cyclictest0-21swapper/119:20:011
1541808993527,4cyclictest0-21swapper/119:20:001
1541808993525,7cyclictest0-21swapper/121:40:151
1541808993525,6cyclictest0-21swapper/121:50:011
1541808993524,7cyclictest1602055-21grep22:00:271
1541807993529,4cyclictest1633184-21kworker/u8:3+events_unbound23:32:330
1541807993525,6cyclictest0-21swapper/000:05:000
1541807993524,6cyclictest0-21swapper/022:10:250
1541807993524,6cyclictest0-21swapper/021:55:250
1541807993523,9cyclictest121ktimers/022:30:130
1541810993426,4cyclictest0-21swapper/321:30:253
1541810993421,4cyclictest131rcu_preempt22:43:053
1541810993420,8cyclictest131rcu_preempt19:14:383
1541810993419,9cyclictest131rcu_preempt22:05:053
1541810993410,5cyclictest131rcu_preempt21:20:173
1541809993425,6cyclictest0-21swapper/223:40:012
1541809993422,8cyclictest301rcuc/223:40:232
1541809993417,5cyclictest131rcu_preempt00:10:352
1541809993416,5cyclictest131rcu_preempt22:05:162
1541809993416,5cyclictest131rcu_preempt21:30:192
1541809993416,5cyclictest131rcu_preempt20:30:202
1541809993416,11cyclictest131rcu_preempt00:25:162
1541809993415,4cyclictest131rcu_preempt21:19:462
1541809993414,5cyclictest131rcu_preempt21:30:022
1541809993413,11cyclictest0-21swapper/222:14:312
1541808993425,5cyclictest0-21swapper/122:35:171
1541807993428,4cyclictest1584958-21kworker/u8:3+events_unbound21:17:110
1541807993426,4cyclictest0-21swapper/020:05:260
154181099336,6cyclictest40-21ksoftirqd/323:55:173
154181099335,7cyclictest40-21ksoftirqd/322:30:193
1541810993326,4cyclictest0-21swapper/321:00:283
1541810993325,4cyclictest0-21swapper/319:21:563
1541810993312,6cyclictest131rcu_preempt00:09:593
1541810993311,4cyclictest131rcu_preempt21:35:143
1541809993325,4cyclictest0-21swapper/219:25:252
1541809993318,4cyclictest131rcu_preempt23:20:222
1541809993317,9cyclictest131rcu_preempt22:20:152
1541809993316,9cyclictest1649678-21kworker/u8:0-events_freezable_power_00:31:512
1541809993313,10cyclictest131rcu_preempt20:15:162
1541809993310,11cyclictest32-21ksoftirqd/222:25:132
1541808993326,4cyclictest0-21swapper/119:45:181
1541808993325,4cyclictest0-21swapper/123:55:001
1541807993327,4cyclictest1631301-21unixbench_singl23:25:260
1541807993325,5cyclictest1574327-21unixbench_multi20:40:250
1541807993317,6cyclictest1631470-21kworker/u8:0+events_unbound23:36:290
1541810993223,5cyclictest0-21swapper/319:45:013
1541810993223,5cyclictest0-21swapper/319:45:013
1541810993222,7cyclictest381rcuc/300:16:533
1541810993220,8cyclictest1598639-21grep21:50:243
1541810993220,4cyclictest131rcu_preempt23:33:013
1541810993217,3cyclictest131rcu_preempt23:40:233
1541810993216,6cyclictest1633184-21kworker/u8:3+events_unbound23:55:003
1541810993216,5cyclictest1631470-21kworker/u8:0+events_unbound23:27:463
1541809993219,5cyclictest131rcu_preempt22:40:222
1541809993215,5cyclictest131rcu_preempt21:55:152
1541809993214,4cyclictest131rcu_preempt22:16:442
1541809993212,12cyclictest131rcu_preempt21:45:222
1541809993211,10cyclictest131rcu_preempt19:40:182
1541809993211,10cyclictest131rcu_preempt19:40:182
1541809993210,11cyclictest32-21ksoftirqd/220:10:172
1541808993224,4cyclictest0-21swapper/119:40:271
1541808993224,4cyclictest0-21swapper/119:40:271
154180799329,6cyclictest131rcu_preempt19:45:130
1541807993225,4cyclictest0-21swapper/023:50:000
1541807993224,4cyclictest0-21swapper/020:12:010
1541807993222,6cyclictest1570891-21grep20:30:250
1541807993214,10cyclictest1593927-21kworker/u8:2+events_unbound21:43:040
154181099318,4cyclictest391ktimers/322:40:013
1541810993123,4cyclictest0-21swapper/300:10:273
1541810993121,7cyclictest391ktimers/321:45:283
1541810993121,7cyclictest391ktimers/321:20:013
1541810993117,5cyclictest131rcu_preempt00:00:213
1541810993113,4cyclictest391ktimers/319:58:393
1541810993113,3cyclictest131rcu_preempt19:48:213
1541810993112,9cyclictest131rcu_preempt20:35:143
1541810993111,5cyclictest131rcu_preempt20:05:243
154180999314,15cyclictest32-21ksoftirqd/222:35:252
1541809993124,5cyclictest204-21dbus-daemon23:07:292
1541809993118,4cyclictest131rcu_preempt20:55:132
1541809993115,5cyclictest1605837-21kworker/u8:3-writeback22:30:022
1541809993115,4cyclictest131rcu_preempt23:00:122
1541809993112,5cyclictest131rcu_preempt00:35:162
1541809993112,10cyclictest131rcu_preempt23:50:212
1541808993123,6cyclictest231ktimers/120:40:131
1541808993123,5cyclictest1550903-21munin-plugin-st19:35:011
1541808993123,4cyclictest0-21swapper/121:05:171
1541807993120,7cyclictest0-21swapper/020:00:250
1541807993120,6cyclictest0-21swapper/023:00:260
1541807993120,6cyclictest0-21swapper/019:55:270
1541807993119,8cyclictest1581390-21grep21:00:280
1541807993117,8cyclictest131rcu_preempt20:46:560
1541807993116,5cyclictest1541805-21cyclictest00:10:010
1541807993115,10cyclictest131rcu_preempt22:20:190
1541807993114,5cyclictest1543123-21kworker/u8:3+events_unbound19:21:130
154180799310,14cyclictest1621246-21cron23:00:000
154181099303,7cyclictest40-21ksoftirqd/323:35:233
154181099303,7cyclictest40-21ksoftirqd/322:25:193
1541810993020,7cyclictest391ktimers/321:00:013
1541810993020,7cyclictest391ktimers/320:05:013
1541810993018,3cyclictest131rcu_preempt23:47:363
1541810993013,11cyclictest0-21swapper/300:34:533
1541810993012,9cyclictest131rcu_preempt22:15:223
1541810993012,12cyclictest1567846-21kworker/u8:1-ext4-rsv-conversion20:30:153
154180999302,18cyclictest0-21swapper/219:30:152
1541809993012,4cyclictest131rcu_preempt00:16:482
1541808993023,5cyclictest1605837-21kworker/u8:3+events_unbound22:22:231
1541808993023,4cyclictest0-21swapper/123:35:241
1541808993023,4cyclictest0-21swapper/122:45:161
1541808993022,4cyclictest0-21swapper/122:10:161
154180799307,12cyclictest131rcu_preempt22:05:250
1541807993024,4cyclictest0-21swapper/021:30:110
1541807993020,6cyclictest0-21swapper/023:40:250
1541807993020,6cyclictest0-21swapper/019:55:010
154181099299,5cyclictest131rcu_preempt22:00:233
1541810992921,5cyclictest391ktimers/319:25:153
1541810992919,6cyclictest391ktimers/321:40:153
1541810992916,9cyclictest1621509-21seq23:00:143
1541810992915,5cyclictest131rcu_preempt00:20:123
1541810992915,3cyclictest131rcu_preempt23:05:153
1541810992915,3cyclictest131rcu_preempt22:20:293
1541810992914,4cyclictest131rcu_preempt19:53:423
1541810992912,5cyclictest131rcu_preempt20:25:113
1541809992912,4cyclictest131rcu_preempt19:55:022
1541808992922,4cyclictest0-21swapper/100:20:151
1541808992918,7cyclictest1-21systemd20:32:041
154180799296,3cyclictest0-21swapper/000:35:150
1541807992922,5cyclictest1651414-21kworker/u8:1+events_unbound00:28:580
1541807992922,3cyclictest0-21swapper/022:50:240
1541807992921,4cyclictest0-21swapper/023:07:280
1541807992918,7cyclictest0-21swapper/020:20:220
1541807992917,4cyclictest1524942-21kworker/u8:1+events_unbound19:16:160
1541807992917,4cyclictest1524942-21kworker/u8:1+events_unbound19:16:160
1541807992916,4cyclictest1586910-21kworker/u8:2+events_unbound21:22:490
1541807992910,9cyclictest11-21ksoftirqd/021:25:250
154181099284,7cyclictest40-21ksoftirqd/322:55:153
154181099284,7cyclictest40-21ksoftirqd/320:50:183
154181099281,15cyclictest0-21swapper/300:35:153
1541808992821,4cyclictest1587136-21sh21:20:011
1541808992821,4cyclictest0-21swapper/100:30:241
1541807992817,6cyclictest131rcu_preempt22:25:120
1541807992817,5cyclictest131rcu_preempt19:35:260
1541807992817,5cyclictest131rcu_preempt19:35:260
154180799281,2cyclictest0-21swapper/021:05:120
1541808992720,5cyclictest1581456-21kworker/u8:2+events_unbound21:02:071
1541808992720,5cyclictest1557506-21kworker/u8:0+events_unbound19:57:011
1541808992720,4cyclictest1576072-21grep20:45:261
1541808992719,5cyclictest438-21cron00:00:011
1541808992719,5cyclictest1645570-21head00:05:261
1541808992717,7cyclictest1615678-21grep22:40:241
154180899271,4cyclictest0-21swapper/100:04:381
154180799275,6cyclictest131rcu_preempt20:25:230
1541807992719,5cyclictest0-21swapper/022:40:150
1541807992714,7cyclictest131rcu_preempt23:20:230
154180799271,13cyclictest0-21swapper/020:50:130
1541808992619,4cyclictest0-21swapper/123:30:161
1541808992617,6cyclictest0-21swapper/119:40:011
1541808992617,6cyclictest0-21swapper/119:40:011
1541808992616,7cyclictest1577941-21unixbench_multi20:50:251
1541807992618,6cyclictest1584958-21kworker/u8:3+events_unbound21:48:360
1541807992613,7cyclictest1559219-21kworker/u8:2+events_unbound20:15:140
1541807992611,9cyclictest131rcu_preempt20:35:250
1541808992519,4cyclictest1548771-21grep19:25:251
1541808992519,4cyclictest1541805-21cyclictest00:35:191
1541808992518,5cyclictest1616091-21kworker/u8:1+events_unbound23:06:421
1541808992517,5cyclictest0-21swapper/123:20:161
1541807992512,6cyclictest11-21ksoftirqd/022:15:160
1541807992510,9cyclictest131rcu_preempt19:30:190
1541808992416,5cyclictest1600813-21sendmail-msp22:00:001
154180899241,4cyclictest1563660-21/usr/sbin/munin20:10:231
154180899238,6cyclictest1543123-21kworker/u8:3+events_unbound19:21:551
1541808992317,3cyclictest0-21swapper/122:55:261
1541808992317,3cyclictest0-21swapper/122:30:251
1541808992317,3cyclictest0-21swapper/120:00:131
1541808992316,4cyclictest0-21swapper/120:30:021
1541808992316,4cyclictest0-21swapper/100:15:251
1541808992315,4cyclictest0-21swapper/123:15:181
154180899231,4cyclictest131rcu_preempt20:15:251
1541808992211,8cyclictest1652216-21memory00:25:171
1541808992211,8cyclictest1630241-21apt-get23:25:111
1541808992211,7cyclictest1593113-21wc21:35:221
1541808992115,3cyclictest0-21swapper/121:50:241
1541808992114,4cyclictest1543763-21cpuspeed19:15:021
1541808992113,5cyclictest1618294-21fschecks_time22:50:141
1541808992111,7cyclictest1572027-21cat20:35:201
1541808992015,3cyclictest1636201-21threads23:40:241
1541808992014,3cyclictest0-21swapper/121:30:241
154180899201,16cyclictest1587390-21taskset21:20:111
1541808992010,7cyclictest1647381-21sed00:10:271
154180899199,7cyclictest1578609-21date20:55:021
154180899199,7cyclictest1557336-21seq19:50:391
154180899192,13cyclictest1585234-21munin-plugin-st21:15:011
1541808991912,4cyclictest1624902-21/usr/sbin/munin23:10:191
154180899187,6cyclictest1561432-21cat20:05:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional