You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 21:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Sep 01, 2026 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1452090995520,11cyclictest1469354-21sed07:55:233
1452090994936,9cyclictest391ktimers/312:35:123
1452090994936,9cyclictest391ktimers/312:35:123
1452078994940,5cyclictest0-21swapper/009:20:000
1452078994940,5cyclictest0-21swapper/009:20:000
1452090994820,11cyclictest1502174-21sed09:30:243
1452090994738,5cyclictest1486947-21idleruntime-cro08:50:003
1452090994719,11cyclictest1538172-21cat11:15:203
1452082994733,10cyclictest231ktimers/109:45:131
1452078994640,4cyclictest1558297-21kworker/u8:2+events_unbound12:20:130
1452082994537,5cyclictest1511232-21munin-run10:00:001
1452078994537,6cyclictest121ktimers/007:45:140
1452078994436,5cyclictest1558297-21kworker/u8:2+events_unbound12:15:120
1452078994415,6cyclictest131rcu_preempt10:15:130
1452090994333,5cyclictest1535770-21apt-get11:10:123
1452090994332,8cyclictest1556872-21apt-get12:10:133
1452090994319,8cyclictest1509756-21/usr/sbin/munin09:55:213
1452087994333,7cyclictest1453866-21munin-node07:15:012
1452078994335,5cyclictest1490222-21kworker/u8:1+events_unbound08:59:310
1452090994229,9cyclictest1474760-21sshd08:12:283
1452090994229,10cyclictest1458782-21/usr/sbin/munin07:25:233
1452090994128,10cyclictest1563071-21/usr/sbin/munin12:25:263
1452090994128,10cyclictest1563071-21/usr/sbin/munin12:25:253
1452090994126,10cyclictest1544772-21/usr/sbin/munin11:35:143
1452090994126,10cyclictest1503712-21/usr/sbin/munin09:35:253
1452090994126,10cyclictest1457080-21/usr/sbin/munin07:20:253
1452087994127,10cyclictest311ktimers/208:50:132
1452082994132,7cyclictest231ktimers/111:30:131
1452090994033,4cyclictest1475222-21apt-get08:15:143
1452090994032,4cyclictest1463294-21apt-get07:40:123
1452090994030,7cyclictest1539519-21/usr/sbin/munin11:20:143
1452090994028,9cyclictest1521580-21sshd10:26:193
1452090994028,9cyclictest1484488-21/usr/sbin/munin08:40:253
1452090994028,8cyclictest1525730-21/usr/sbin/munin10:40:163
1452090994026,11cyclictest1532965-21/usr/sbin/munin11:00:233
1452090994026,11cyclictest1470786-21/usr/sbin/munin08:00:243
1452090994026,11cyclictest1470786-21/usr/sbin/munin08:00:243
1452090994024,11cyclictest1465110-21/usr/sbin/munin07:45:163
1452090994023,12cyclictest1523586-21cron10:35:003
1452090994022,14cyclictest1478414-21idleruntime-cro08:25:013
1452090994021,14cyclictest1544055-21head11:30:293
1452090994019,16cyclictest1554536-21grep12:00:253
1452090994019,16cyclictest1461489-21latency_hist07:35:013
1452082994012,4cyclictest131rcu_preempt09:35:131
1452078994027,9cyclictest1512740-21grep10:00:280
1452078994025,5cyclictest1521543-21kworker/u8:0+events_unbound10:30:120
1452090993929,7cyclictest1535150-21users11:05:283
1452090993929,7cyclictest1461577-21apt-get07:35:143
1452090993929,6cyclictest0-21swapper/308:40:013
1452090993928,7cyclictest1561749-21sh12:25:003
1452090993928,7cyclictest0-21swapper/310:40:003
1452090993927,9cyclictest1547563-21timerwakeupswit11:40:263
1452090993927,9cyclictest1517116-21/usr/sbin/munin10:15:183
1452090993927,9cyclictest1455097-21/usr/sbin/munin07:15:203
1452090993927,7cyclictest1529211-21/usr/sbin/munin10:50:173
1452090993927,7cyclictest1529211-21/usr/sbin/munin10:50:173
1452090993926,10cyclictest1491771-21/usr/sbin/munin09:00:243
1452090993925,10cyclictest1452243-21/usr/sbin/munin07:10:123
1452090993923,12cyclictest1555466-21if_eth012:05:173
1452090993922,12cyclictest1494381-21fschecks_count09:10:153
1452087993931,4cyclictest0-21swapper/210:29:522
1452082993927,9cyclictest1453819-21apt-key07:15:021
1452078993929,7cyclictest1473277-21cron08:10:010
1452078993928,8cyclictest1554931-21auditctl12:05:000
1452090993831,3cyclictest1499541-21apt-get09:25:173
1452090993829,6cyclictest1508581-21/usr/sbin/munin09:50:223
1452090993828,7cyclictest1492499-21/usr/sbin/munin09:05:143
1452090993827,8cyclictest1548683-21/usr/sbin/munin11:45:173
1452090993827,8cyclictest1541619-21/usr/sbin/munin11:25:173
1452090993827,8cyclictest1541619-21/usr/sbin/munin11:25:173
1452090993827,8cyclictest1513838-21/usr/sbin/munin10:05:193
1452090993827,7cyclictest0-21swapper/309:19:363
1452090993827,7cyclictest0-21swapper/309:19:363
1452090993827,6cyclictest391ktimers/310:00:153
1452090993826,9cyclictest1563852-21/usr/sbin/munin12:30:163
1452090993826,9cyclictest1563852-21/usr/sbin/munin12:30:163
1452090993826,9cyclictest1518790-21/usr/sbin/munin10:20:163
1452090993826,7cyclictest1506487-21/usr/sbin/munin09:45:173
1452090993825,10cyclictest1487455-21/usr/sbin/munin08:50:173
1452090993824,10cyclictest1531722-21/usr/sbin/munin10:55:263
1452090993824,10cyclictest1531722-21/usr/sbin/munin10:55:263
1452090993823,12cyclictest1505329-21/usr/sbin/munin09:40:223
1452090993823,10cyclictest1550488-21/usr/sbin/munin11:50:203
1452090993821,13cyclictest1481355-21tail08:30:273
1452082993829,5cyclictest0-21swapper/107:25:151
1452082993826,8cyclictest1553219-21munin-plugin-st12:00:001
1452078993830,4cyclictest0-21swapper/011:50:050
1452078993828,7cyclictest1454052-21apt-config07:15:020
1452078993813,5cyclictest131rcu_preempt09:10:120
1452090993728,6cyclictest1489421-21/usr/sbin/munin08:55:183
1452090993727,7cyclictest1551865-21diskstats11:55:153
1452090993725,7cyclictest1466695-21/usr/sbin/munin07:50:133
1452090993724,10cyclictest1498075-21/usr/sbin/munin09:20:223
1452090993724,10cyclictest1498075-21/usr/sbin/munin09:20:213
1452090993724,10cyclictest1479767-21cron08:26:003
1452087993731,4cyclictest1451905-21kworker/u8:2+events_unbound07:19:122
1452087993727,6cyclictest1469866-21auditctl08:00:012
1452087993727,6cyclictest0-21swapper/209:25:002
1452087993727,6cyclictest0-21swapper/209:25:002
1452082993727,5cyclictest0-21swapper/108:54:301
145207899371,9cyclictest11-21ksoftirqd/007:30:130
1452090993627,6cyclictest1515227-21/usr/sbin/munin10:10:173
1452090993626,6cyclictest1558569-21/usr/sbin/munin12:15:123
1452087993630,4cyclictest1483350-21kworker/u8:3+events_unbound09:09:332
1452087993629,4cyclictest0-21swapper/208:30:002
1452087993625,8cyclictest438-21cron11:25:002
1452082993627,6cyclictest0-21swapper/108:05:011
1452082993627,6cyclictest0-21swapper/108:05:011
1452082993625,7cyclictest1481361-21grep08:30:261
145207899366,5cyclictest131rcu_preempt09:55:110
145207899366,4cyclictest131rcu_preempt11:40:130
145207899361,9cyclictest11-21ksoftirqd/007:15:150
1452078993618,5cyclictest131rcu_preempt08:00:130
1452078993618,5cyclictest131rcu_preempt08:00:120
1452090993525,7cyclictest1527369-21/usr/sbin/munin10:45:153
1452090993524,8cyclictest1472943-21cron08:06:013
1452082993527,5cyclictest1510950-21kworker/u8:2+events_unbound10:10:021
1452082993525,6cyclictest0-21swapper/112:15:251
1452078993525,7cyclictest1529995-21grep10:50:250
1452078993525,7cyclictest1529995-21grep10:50:250
1452078993516,4cyclictest1526692-21runrttasks10:41:140
1452087993426,4cyclictest0-21swapper/210:15:152
1452087993425,4cyclictest0-21swapper/210:00:012
1452082993426,5cyclictest0-21swapper/108:15:001
1452082993424,6cyclictest0-21swapper/109:25:011
1452082993424,6cyclictest0-21swapper/109:25:001
1452082993419,5cyclictest1521543-21kworker/u8:0+events_unbound11:10:241
1452078993427,5cyclictest1481489-21kworker/u8:0+events_unbound08:40:390
1452078993424,7cyclictest1521449-21grep10:25:260
1452078993424,6cyclictest121ktimers/010:55:140
1452078993424,6cyclictest121ktimers/010:55:130
1452078993416,6cyclictest1563903-21kworker/u8:1+events_unbound12:31:300
1452078993416,6cyclictest1563903-21kworker/u8:1+events_unbound12:31:290
1452087993325,4cyclictest0-21swapper/208:10:162
1452087993324,6cyclictest1539164-21sh11:20:002
1452087993321,9cyclictest311ktimers/211:00:122
1452082993327,4cyclictest1548023-21kworker/u8:0+events_unbound12:02:411
1452082993323,6cyclictest0-21swapper/109:00:241
145207899334,5cyclictest131rcu_preempt09:50:130
1452078993326,4cyclictest0-21swapper/011:20:000
1452087993225,4cyclictest0-21swapper/212:40:002
1452087993225,4cyclictest0-21swapper/212:39:592
1452087993222,6cyclictest0-21swapper/211:45:012
1452087993221,7cyclictest0-21swapper/211:45:252
1452082993224,4cyclictest0-21swapper/112:20:101
1452082993224,4cyclictest0-21swapper/109:00:011
1452082993223,6cyclictest0-21swapper/107:55:141
145208299320,13cyclictest0-21swapper/112:10:141
1452078993224,5cyclictest1-21systemd11:25:020
1452087993125,3cyclictest0-21swapper/208:40:002
1452087993122,4cyclictest0-21swapper/209:00:232
1452087993121,6cyclictest0-21swapper/208:00:262
1452087993121,6cyclictest0-21swapper/208:00:262
1452082993124,4cyclictest0-21swapper/109:15:271
1452082993124,4cyclictest0-21swapper/109:15:271
1452082993124,4cyclictest0-21swapper/108:35:271
1452082993123,4cyclictest0-21swapper/108:15:171
1452082993119,6cyclictest1521543-21kworker/u8:0+events_unbound10:45:071
145208299311,6cyclictest131rcu_preempt10:40:121
1452082993116,6cyclictest1466426-21kworker/u8:2+events_unbound07:53:291
1452078993125,4cyclictest0-21swapper/011:30:140
1452078993124,3cyclictest0-21swapper/007:35:260
145207899311,5cyclictest1476694-21sh08:20:000
1452078993112,10cyclictest131rcu_preempt08:30:160
145207899310,3cyclictest0-21swapper/009:30:120
1452087993024,4cyclictest1497388-21sendmail09:20:012
1452087993024,4cyclictest1497388-21sendmail09:20:002
1452087993022,4cyclictest0-21swapper/212:30:162
1452087993022,4cyclictest0-21swapper/212:30:162
1452087993021,6cyclictest0-21swapper/210:59:592
1452087993021,6cyclictest0-21swapper/210:59:592
145208299304,4cyclictest131rcu_preempt12:25:121
145208299304,4cyclictest131rcu_preempt12:25:111
1452082993024,4cyclictest1481489-21kworker/u8:0+events_unbound08:40:471
1452082993023,5cyclictest1528934-21kworker/u8:2+events_unbound11:25:011
1452082993023,5cyclictest1528934-21kworker/u8:2+events_unbound11:25:011
1452082993022,6cyclictest1546467-21latency_hist11:40:001
1452082993020,7cyclictest1461778-21tune2fs07:35:181
1452082993020,6cyclictest0-21swapper/112:05:271
1452082993020,6cyclictest0-21swapper/110:35:011
1452082993018,6cyclictest1528934-21kworker/u8:2+events_unbound11:05:181
1452082993011,5cyclictest1564699-21unixbench_multi12:30:271
1452082993011,5cyclictest1564699-21unixbench_multi12:30:271
145207899309,11cyclictest131rcu_preempt10:05:250
1452078993024,4cyclictest1521543-21kworker/u8:0+events_unbound10:35:400
1452078993023,4cyclictest1483535-21sendmail08:40:010
1452078993022,4cyclictest0-21swapper/008:45:240
1452078993020,6cyclictest0-21swapper/009:25:300
1452087992922,4cyclictest0-21swapper/211:05:272
1452087992921,5cyclictest0-21swapper/210:45:242
1452087992921,4cyclictest0-21swapper/209:10:262
1452087992919,6cyclictest0-21swapper/212:30:002
1452087992919,6cyclictest0-21swapper/212:30:002
1452087992918,8cyclictest1-21systemd11:35:022
1452082992921,4cyclictest0-21swapper/110:35:191
1452082992919,8cyclictest231ktimers/110:15:111
145208299291,5cyclictest131rcu_preempt07:45:121
1452082992915,7cyclictest1490222-21kworker/u8:1+events_unbound09:05:141
145207899297,5cyclictest0-21swapper/011:55:120
145207899293,7cyclictest11-21ksoftirqd/009:05:140
1452078992921,6cyclictest1528934-21kworker/u8:2+events_unbound11:03:420
1452078992919,6cyclictest0-21swapper/011:10:260
145207899291,12cyclictest0-21swapper/007:54:570
145207899290,12cyclictest11-21ksoftirqd/011:25:120
145207899290,12cyclictest11-21ksoftirqd/011:25:120
1452087992821,4cyclictest0-21swapper/211:10:272
1452087992821,4cyclictest0-21swapper/210:50:262
1452087992821,4cyclictest0-21swapper/210:50:262
1452087992817,6cyclictest0-21swapper/212:15:252
1452082992821,4cyclictest0-21swapper/107:20:171
1452082992820,4cyclictest0-21swapper/109:25:301
1452082992819,6cyclictest0-21swapper/107:15:021
1452082992819,5cyclictest0-21swapper/110:25:001
1452082992816,6cyclictest1500968-21kworker/u8:3+events_unbound09:40:151
145207899289,6cyclictest11-21ksoftirqd/012:10:260
1452078992819,6cyclictest1516094-21grep10:10:270
1452078992813,6cyclictest1546275-21wc11:40:000
1452078992812,3cyclictest131rcu_preempt11:09:570
145207899281,15cyclictest0-21swapper/007:23:520
145207899281,14cyclictest0-21swapper/009:43:450
145207899281,13cyclictest0-21swapper/008:14:170
1452087992719,4cyclictest0-21swapper/209:40:002
1452087992718,6cyclictest1542319-21unixbench_multi11:25:242
1452087992718,6cyclictest1542319-21unixbench_multi11:25:242
1452082992720,5cyclictest1505822-21kworker/u8:0+events_unbound10:11:411
145207899275,5cyclictest1503969-21grep09:35:260
1452078992720,5cyclictest1528934-21kworker/u8:2+events_unbound11:48:400
1452078992720,5cyclictest1462950-21kworker/u8:1+events_unbound08:29:280
1452078992712,4cyclictest131rcu_preempt08:50:120
1452087992619,5cyclictest1466426-21kworker/u8:2+events_unbound08:05:252
1452087992618,5cyclictest0-21swapper/207:45:002
1452087992618,4cyclictest0-21swapper/210:00:202
1452082992619,5cyclictest1462950-21kworker/u8:1+events_unbound07:44:161
1452082992618,5cyclictest0-21swapper/112:39:591
1452082992618,5cyclictest0-21swapper/112:39:591
145208299261,5cyclictest1480117-21munin-run08:30:011
1452082992615,5cyclictest1462950-21kworker/u8:1+events_unbound08:20:581
1452082992613,4cyclictest131rcu_preempt08:05:061
1452078992621,3cyclictest13550irq/42-30be0000.ethernet12:35:130
1452078992621,3cyclictest13550irq/42-30be0000.ethernet12:35:120
1452078992620,4cyclictest1500968-21kworker/u8:3+events_unbound09:46:000
1452087992518,4cyclictest0-21swapper/210:30:162
1452087992518,4cyclictest0-21swapper/207:50:272
1452087992515,6cyclictest0-21swapper/208:20:262
145208299256,10cyclictest145-21jbd2/mmcblk1p2-810:55:061
145208299256,10cyclictest145-21jbd2/mmcblk1p2-810:55:061
145208299254,15cyclictest0-21swapper/111:50:171
145208299253,5cyclictest131rcu_preempt09:50:131
1452082992519,4cyclictest1528934-21kworker/u8:2+events_unbound11:15:551
1452082992518,4cyclictest1521543-21kworker/u8:0-ext4-rsv-conversion10:30:001
1452082992518,4cyclictest1486240-21switchtime08:45:231
1452082992516,5cyclictest0-21swapper/111:00:261
145207899256,6cyclictest11-21ksoftirqd/010:20:140
1452078992514,8cyclictest1463439-21cut07:40:160
145207899251,13cyclictest0-21swapper/008:23:330
145207899251,12cyclictest0-21swapper/009:23:080
145207899251,12cyclictest0-21swapper/009:23:080
145207899250,7cyclictest1491418-21ps09:00:220
1452087992416,5cyclictest0-21swapper/207:30:012
1452087992416,4cyclictest0-21swapper/208:30:262
1452082992417,5cyclictest1500968-21kworker/u8:3+events_unbound09:33:421
1452082992416,5cyclictest0-21swapper/111:40:281
1452082992414,7cyclictest1461337-21sh07:35:011
1452082992411,6cyclictest1521543-21kworker/u8:0+events_unbound10:50:421
1452082992411,6cyclictest1521543-21kworker/u8:0+events_unbound10:50:411
1452078992418,4cyclictest1558297-21kworker/u8:2+events_unbound12:25:230
1452078992418,4cyclictest1558297-21kworker/u8:2+events_unbound12:25:230
145207899240,20cyclictest0-21swapper/007:27:010
1452087992317,3cyclictest0-21swapper/212:10:012
1452087992317,3cyclictest0-21swapper/209:40:212
145208799231,5cyclictest131rcu_preempt09:25:172
1452082992316,5cyclictest1483350-21kworker/u8:3+events_unbound09:10:121
1452082992315,5cyclictest0-21swapper/111:45:261
1452082992314,7cyclictest1540527-21kworker/u8:1+events_unbound11:21:221
1452082992314,6cyclictest0-21swapper/110:00:201
1452078992315,5cyclictest0-21swapper/012:05:260
1452087992216,4cyclictest1558297-21kworker/u8:2+events_unbound12:22:202
1452087992216,4cyclictest1523248-21kworker/u8:1+events_unbound10:39:022
1452087992216,3cyclictest0-21swapper/211:50:242
1452087992216,3cyclictest0-21swapper/207:35:242
1452087992215,5cyclictest1523248-21kworker/u8:1+events_unbound10:40:132
1452087992215,3cyclictest0-21swapper/208:40:272
1452087992214,6cyclictest1462950-21kworker/u8:1+events_unbound08:19:242
1452087992214,5cyclictest0-21swapper/209:30:232
1452087992213,5cyclictest703678-1kworker/2:0H+kblockd07:50:012
1452087992115,4cyclictest1528934-21kworker/u8:2+events_unbound11:57:122
1452087992114,5cyclictest311ktimers/210:05:132
145208799210,6cyclictest1490547-21apt09:00:002
1452087992016,2cyclictest1453694-21kworker/u8:0+events_unbound07:20:412
1452087992014,3cyclictest0-21swapper/210:20:222
1452087992014,3cyclictest0-21swapper/208:50:012
1452087992012,6cyclictest311ktimers/211:30:302
145208799199,7cyclictest1508180-21diskstats09:50:172
1452087991914,3cyclictest0-21swapper/212:10:232
1452087991911,6cyclictest1515566-21sed10:10:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional