You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 22:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Apr 06, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1581038995042,4cyclictest0-21swapper/107:15:001
1581032994942,4cyclictest1586635-21grep07:20:250
1581045994740,4cyclictest0-21swapper/308:10:013
1581043994536,5cyclictest1627142-21fschecks_count09:20:152
1581038994436,5cyclictest1585175-21munin-plugin-st07:20:001
1581045994336,3cyclictest0-21swapper/308:30:013
1581043994336,4cyclictest1602445-21idleruntime-cro08:10:012
1581032994235,4cyclictest1585179-21cron07:20:010
1581045994134,4cyclictest438-21cron12:30:013
1581038994131,5cyclictest0-21swapper/112:20:011
1581032994134,5cyclictest1593879-21kworker/u8:1+events_unbound07:45:110
1581032994132,5cyclictest0-21swapper/012:25:010
1581045994029,8cyclictest1678283-21apt-key11:50:013
1581043994030,6cyclictest1655489-21unixbench_multi10:40:252
1581043994030,6cyclictest0-21swapper/211:00:012
1581038994030,7cyclictest1690246-21sh12:25:001
1581043993930,6cyclictest1680385-21fschecks_count11:55:172
1581043993930,5cyclictest0-21swapper/207:40:002
1581038993931,4cyclictest1695341-21cron12:40:011
1581038993926,9cyclictest1674218-21grep11:35:241
1581038993926,9cyclictest1674218-21grep11:35:231
1581032993933,4cyclictest1593879-21kworker/u8:1+events_unbound08:45:340
1581045993828,6cyclictest1674668-21cron11:40:003
1581045993828,6cyclictest1674668-21cron11:40:003
1581043993827,7cyclictest0-21swapper/210:25:002
1581043993826,7cyclictest0-21swapper/207:30:242
1581038993829,5cyclictest0-21swapper/110:40:261
1581032993832,3cyclictest0-21swapper/011:00:000
1581045993730,4cyclictest0-21swapper/312:30:143
1581043993730,3cyclictest0-21swapper/211:45:002
1581043993730,3cyclictest0-21swapper/211:44:592
1581038993726,6cyclictest1605446-21grep08:15:251
1581032993730,4cyclictest1625019-21sh09:15:000
1581032993727,5cyclictest0-21swapper/008:15:240
1581045993627,5cyclictest0-21swapper/307:15:023
1581045993625,7cyclictest0-21swapper/310:55:013
1581043993626,6cyclictest0-21swapper/207:20:262
1581043993625,7cyclictest0-21swapper/208:15:252
1581043993625,6cyclictest0-21swapper/211:50:242
1581043993625,6cyclictest0-21swapper/209:35:252
1581043993624,7cyclictest0-21swapper/209:00:242
1581038993629,5cyclictest1579104-21kworker/u8:2+events_unbound08:05:201
1581038993627,6cyclictest0-21swapper/111:20:011
1581038993627,5cyclictest0-21swapper/110:05:261
1581038993627,5cyclictest0-21swapper/110:05:261
1581032993629,5cyclictest1605881-21kworker/u8:2+events_unbound09:50:510
1581032993626,5cyclictest1640167-21grep09:55:260
1581032993625,7cyclictest1693179-21grep12:30:230
1581045993528,3cyclictest0-21swapper/312:20:013
1581045993527,5cyclictest0-21swapper/309:20:163
1581045993527,4cyclictest0-21swapper/310:30:153
1581045993527,4cyclictest0-21swapper/307:55:143
1581045993525,6cyclictest0-21swapper/308:20:003
1581043993526,6cyclictest0-21swapper/212:40:012
1581043993524,7cyclictest0-21swapper/207:15:262
1581038993527,5cyclictest1587096-21cron07:25:011
1581038993527,5cyclictest0-21swapper/109:25:011
1581038993524,7cyclictest1635476-21sort09:45:011
1581032993528,3cyclictest0-21swapper/009:45:000
1581032993526,6cyclictest1694071-21grep12:35:170
1581045993426,4cyclictest0-21swapper/310:00:013
1581045993426,4cyclictest0-21swapper/307:30:003
1581043993427,5cyclictest1593879-21kworker/u8:1+events_unbound07:55:142
1581043993427,4cyclictest0-21swapper/212:30:242
1581043993427,3cyclictest0-21swapper/211:15:012
1581043993425,5cyclictest1641840-21unixbench_multi10:00:262
1581043993424,6cyclictest0-21swapper/212:25:162
1581043993424,6cyclictest0-21swapper/209:15:412
1581038993427,4cyclictest1626750-21sendmail09:20:011
1581038993426,4cyclictest0-21swapper/109:10:231
1581038993426,4cyclictest0-21swapper/108:45:171
1581038993425,5cyclictest0-21swapper/109:35:001
1581038993424,7cyclictest1693645-21sh12:35:011
1581038993421,10cyclictest231ktimers/111:20:121
1581032993427,5cyclictest1655721-21kworker/u8:0+events_unbound11:41:060
1581032993427,5cyclictest1655721-21kworker/u8:0+events_unbound11:41:050
1581032993426,5cyclictest0-21swapper/007:10:010
1581032993426,5cyclictest0-21swapper/007:10:000
1581045993325,5cyclictest1656313-21sort10:45:193
1581045993323,6cyclictest0-21swapper/311:15:243
1581043993327,4cyclictest1664462-21munin-run11:10:002
1581043993325,4cyclictest0-21swapper/209:05:272
1581043993324,5cyclictest0-21swapper/212:20:262
1581043993324,5cyclictest0-21swapper/208:30:242
1581043993323,6cyclictest0-21swapper/210:45:282
1581043993323,6cyclictest0-21swapper/209:10:242
1581043993323,6cyclictest0-21swapper/209:00:002
1581043993323,6cyclictest0-21swapper/207:25:162
1581043993322,6cyclictest0-21swapper/207:15:012
1581038993324,6cyclictest0-21swapper/112:25:251
1581038993323,7cyclictest1612868-21sh08:40:001
1581038993323,6cyclictest0-21swapper/111:50:001
1581038993321,9cyclictest231ktimers/107:30:121
1581038993321,8cyclictest1591759-21grep07:35:251
1581032993324,7cyclictest121ktimers/008:40:110
1581032993324,6cyclictest0-21swapper/012:15:010
1581032993322,7cyclictest1691504-21grep12:25:250
1581045993226,4cyclictest1592118-21kworker/u8:0+events_unbound08:40:323
1581045993226,3cyclictest0-21swapper/307:40:013
1581045993224,6cyclictest391ktimers/312:10:123
1581045993224,4cyclictest0-21swapper/312:35:253
1581043993224,5cyclictest1649691-21kworker/u8:2+events_unbound10:25:552
1581043993224,5cyclictest1607142-21unixbench_singl08:20:262
1581043993224,4cyclictest0-21swapper/212:10:012
1581043993224,3cyclictest0-21swapper/211:15:162
1581043993222,6cyclictest0-21swapper/211:00:152
1581043993222,6cyclictest0-21swapper/210:55:012
1581038993225,3cyclictest0-21swapper/111:55:161
1581038993224,5cyclictest0-21swapper/111:54:591
1581038993224,4cyclictest0-21swapper/111:00:161
1581038993220,7cyclictest1675913-21grep11:40:241
1581038993220,7cyclictest1675913-21grep11:40:241
1581038993220,7cyclictest0-21swapper/112:15:011
1581032993226,3cyclictest0-21swapper/010:40:010
1581032993225,4cyclictest0-21swapper/010:30:240
1581032993225,3cyclictest0-21swapper/008:30:250
1581032993224,3cyclictest0-21swapper/008:20:250
1581045993122,5cyclictest0-21swapper/308:40:013
1581045993121,7cyclictest1643989-21sh10:09:593
1581045993121,7cyclictest1643989-21sh10:09:593
1581043993123,4cyclictest0-21swapper/211:29:592
1581043993123,4cyclictest0-21swapper/208:40:012
1581043993121,6cyclictest0-21swapper/209:50:252
1581043993119,8cyclictest0-21swapper/212:00:262
1581038993125,3cyclictest0-21swapper/111:35:001
1581038993124,4cyclictest0-21swapper/108:25:011
1581032993124,5cyclictest1647046-21kworker/u8:1+events_unbound10:20:530
1581032993123,4cyclictest0-21swapper/009:25:270
1581032993122,6cyclictest0-21swapper/010:45:190
1581032993120,7cyclictest1667382-21grep11:15:240
1581032993120,7cyclictest1646937-21grep10:15:390
1581045993023,4cyclictest0-21swapper/311:10:243
1581045993021,5cyclictest1648690-21unixbench_singl10:20:253
1581045993020,6cyclictest1646936-21grep10:15:393
1581043993022,5cyclictest0-21swapper/210:20:002
1581043993022,4cyclictest0-21swapper/207:50:122
1581043993021,5cyclictest0-21swapper/209:50:002
1581043993020,6cyclictest0-21swapper/208:25:252
1581038993021,5cyclictest0-21swapper/111:10:011
1581038993021,4cyclictest0-21swapper/108:45:011
1581038993020,6cyclictest0-21swapper/110:20:241
158103299304,5cyclictest131rcu_preempt07:15:010
1581032993025,2cyclictest13550irq/42-30be0000.ethernet12:15:220
1581032993024,3cyclictest0-21swapper/011:55:260
1581032993020,6cyclictest1636752-21grep09:45:250
1581032993015,8cyclictest204-21dbus-daemon11:51:060
1581045992925,2cyclictest1671143-21kworker/u8:1+events_unbound11:51:063
1581045992922,5cyclictest1660874-21kworker/u8:2+events_unbound11:00:583
1581045992922,4cyclictest1622056-21tune2fs09:05:173
1581045992922,4cyclictest15926892chrt07:40:173
1581045992921,5cyclictest391ktimers/312:02:503
1581045992921,4cyclictest0-21swapper/310:25:153
1581045992921,4cyclictest0-21swapper/309:40:223
1581043992922,4cyclictest1684806-21kworker/u8:2+events_unbound12:16:072
1581043992920,5cyclictest0-21swapper/211:40:002
1581043992920,5cyclictest0-21swapper/211:40:002
1581043992920,5cyclictest0-21swapper/210:10:152
1581043992920,5cyclictest0-21swapper/210:10:152
1581043992919,6cyclictest0-21swapper/208:50:142
1581038992923,4cyclictest1605881-21kworker/u8:2+events_unbound09:45:521
1581038992921,5cyclictest0-21swapper/108:10:241
1581038992920,5cyclictest0-21swapper/108:25:261
1581038992918,7cyclictest1619702-21ls09:00:001
158103899291,6cyclictest131rcu_preempt07:45:121
158103299293,19cyclictest1619722-21basename09:00:010
1581032992922,4cyclictest0-21swapper/011:00:160
1581032992921,5cyclictest1624711-21kworker/u8:1+events_unbound10:03:420
1581032992921,4cyclictest0-21swapper/008:30:010
1581032992921,4cyclictest0-21swapper/007:35:160
1581032992920,6cyclictest1611617-21grep08:35:150
1581045992823,3cyclictest645-21runrttasks08:00:133
1581045992821,4cyclictest0-21swapper/309:00:013
1581045992819,6cyclictest1585444-21cat07:20:023
1581045992818,7cyclictest1630145-21idleruntime-cro09:30:013
1581045992816,9cyclictest1631361-21grep09:30:253
1581043992821,4cyclictest0-21swapper/210:35:252
1581043992821,4cyclictest0-21swapper/210:00:012
1581043992820,5cyclictest0-21swapper/209:30:002
1581043992820,4cyclictest0-21swapper/211:45:242
1581038992821,4cyclictest0-21swapper/109:55:151
1581038992820,4cyclictest0-21swapper/107:50:121
1581038992819,4cyclictest0-21swapper/109:00:231
1581038992816,9cyclictest1642292-21auditctl10:04:591
158103299286,5cyclictest131rcu_preempt09:30:130
1581032992822,4cyclictest1655721-21kworker/u8:0+events_unbound11:31:060
1581032992820,5cyclictest1592118-21kworker/u8:0+events_unbound07:41:440
1581032992819,6cyclictest0-21swapper/011:15:010
158103299281,8cyclictest0-21swapper/009:05:120
1581032992818,7cyclictest1633550-21sendmail09:40:000
1581032992818,6cyclictest0-21swapper/010:50:260
1581032992816,8cyclictest1601985-21unixbench_multi08:05:260
1581045992721,3cyclictest0-21swapper/311:25:003
1581045992721,3cyclictest0-21swapper/311:00:003
1581045992718,4cyclictest1590037-21grep07:30:253
1581045992717,7cyclictest1637172-21sh09:50:013
1581045992717,5cyclictest1689851-21grep12:20:263
1581043992720,4cyclictest0-21swapper/212:10:242
1581043992720,4cyclictest0-21swapper/207:40:172
1581043992719,5cyclictest0-21swapper/209:45:012
1581043992719,5cyclictest0-21swapper/209:30:252
1581043992719,5cyclictest0-21swapper/207:50:012
158103899276,4cyclictest131rcu_preempt08:30:111
1581038992721,3cyclictest0-21swapper/111:15:001
1581032992721,4cyclictest1618227-21kworker/u8:3+events_unbound09:00:240
1581032992720,3cyclictest0-21swapper/008:00:170
1581032992718,6cyclictest1617205-21/usr/sbin/munin08:50:230
1581045992620,3cyclictest0-21swapper/310:40:263
1581045992620,3cyclictest0-21swapper/308:55:013
1581045992619,4cyclictest0-21swapper/309:00:243
1581038992619,4cyclictest1682173-21fschecks_time12:00:161
1581038992619,3cyclictest0-21swapper/109:50:231
1581038992618,4cyclictest0-21swapper/110:10:161
1581038992618,4cyclictest0-21swapper/110:10:161
1581038992617,6cyclictest0-21swapper/110:19:591
1581038992617,5cyclictest0-21swapper/107:55:141
1581038992616,6cyclictest0-21swapper/109:35:181
1581038992615,7cyclictest1593511-21grep07:40:261
1581038992614,5cyclictest1660553-21grep10:55:261
158104599255,4cyclictest131rcu_preempt07:50:163
158104599253,4cyclictest131rcu_preempt09:50:133
1581045992518,5cyclictest1671143-21kworker/u8:1+events_unbound12:05:113
1581045992518,5cyclictest1605881-21kworker/u8:2+events_unbound08:31:553
1581043992518,5cyclictest1593879-21kworker/u8:1+events_unbound08:13:072
1581043992517,5cyclictest0-21swapper/208:40:252
1581038992519,3cyclictest0-21swapper/110:40:011
1581038992517,6cyclictest1651229-21fschecks_time10:30:161
1581038992516,6cyclictest1649915-21ntpq10:25:211
158103299254,3cyclictest131rcu_preempt11:05:120
1581032992519,4cyclictest1649691-21kworker/u8:2+events_unbound10:27:420
1581032992519,4cyclictest1618227-21kworker/u8:3+events_unbound09:20:410
1581032992519,3cyclictest0-21swapper/011:35:180
1581032992519,3cyclictest0-21swapper/011:35:170
1581032992518,5cyclictest1655721-21kworker/u8:0+events_unbound12:05:580
1581032992517,5cyclictest0-21swapper/011:20:240
1581032992517,5cyclictest0-21swapper/007:30:250
1581032992514,7cyclictest1598562-21unixbench_multi07:55:250
158103299251,12cyclictest0-21swapper/010:12:030
158103299251,12cyclictest0-21swapper/010:12:030
1581045992418,3cyclictest0-21swapper/308:10:253
1581045992417,5cyclictest1605881-21kworker/u8:2+events_unbound08:20:263
1581045992417,4cyclictest0-21swapper/307:45:263
1581043992417,5cyclictest145-21jbd2/mmcblk1p2-811:32:052
1581038992417,4cyclictest0-21swapper/111:25:231
1581038992416,5cyclictest1658047-21grep10:50:151
1581038992416,5cyclictest0-21swapper/107:25:211
1581038992414,7cyclictest1657253-21seq10:45:301
1581038992412,4cyclictest131rcu_preempt08:00:521
1581032992417,4cyclictest0-21swapper/011:25:240
1581032992417,4cyclictest0-21swapper/008:15:000
158103299241,19cyclictest1643540-21tail10:05:250
158103299241,19cyclictest1643540-21tail10:05:250
158104599239,7cyclictest1671755-21/usr/sbin/munin11:30:173
158104599237,8cyclictest0-21swapper/311:05:423
158104599232,4cyclictest131rcu_preempt11:25:263
1581045992317,4cyclictest1605881-21kworker/u8:2+events_unbound09:15:403
1581045992316,4cyclictest0-21swapper/308:45:163
1581045992316,3cyclictest1585852-21fschecks_time07:20:153
1581045992313,8cyclictest0-21swapper/311:55:173
1581045992310,7cyclictest40-21ksoftirqd/311:40:163
1581045992310,7cyclictest40-21ksoftirqd/311:40:163
1581043992317,3cyclictest0-21swapper/211:20:202
1581043992315,5cyclictest0-21swapper/208:45:172
1581038992312,8cyclictest1-21systemd09:25:501
158103299235,4cyclictest131rcu_preempt12:00:110
1581032992315,4cyclictest438-21cron07:30:000
1581032992315,3cyclictest0-21swapper/011:50:010
1581032992313,7cyclictest121ktimers/009:15:110
1581045992216,4cyclictest1633081-21grep09:35:243
1581045992215,3cyclictest0-21swapper/309:10:233
1581043992216,3cyclictest0-21swapper/210:05:232
1581043992216,3cyclictest0-21swapper/210:05:232
1581043992215,5cyclictest0-21swapper/210:30:252
158104399220,12cyclictest1599905-21grep08:00:222
1581038992217,3cyclictest145-21jbd2/mmcblk1p2-812:05:171
1581038992216,3cyclictest0-21swapper/109:05:141
158104599211,2cyclictest0-21swapper/310:10:123
158104599211,2cyclictest0-21swapper/310:10:123
1581045992010,7cyclictest1642341-21cut10:05:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional