You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 19:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Wed Sep 23, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1343735995340,9cyclictest1396056-21kworker/u8:0+events_unbound09:40:121
1343743994940,5cyclictest1382437-21munin-plugin-st09:00:013
1343730994838,7cyclictest121ktimers/011:45:100
1343738994639,4cyclictest1396101-21sendmail09:40:012
1343735994636,7cyclictest1447628-21grep12:05:241
1343735994636,7cyclictest1447628-21grep12:05:241
1343730994639,5cyclictest1451206-21kworker/u8:1+events_unbound12:33:590
1343730994638,5cyclictest1430444-21latency_hist11:20:000
1343743994429,4cyclictest1444297-21kworker/u8:3+events_unbound11:58:523
1343735994430,10cyclictest231ktimers/110:45:131
1343743994320,12cyclictest131rcu_preempt09:00:123
1343738994334,5cyclictest0-21swapper/212:05:002
1343738994334,5cyclictest0-21swapper/212:04:592
1343730994329,7cyclictest131rcu_preempt07:45:130
1343735994232,7cyclictest1354493-21apt-get07:40:001
1343730994235,4cyclictest1386273-21fschecks_time09:10:180
1343730994232,7cyclictest1363454-21apt08:05:000
1343743994134,5cyclictest1370136-21kworker/u8:1+events_unbound08:33:113
1343743994131,6cyclictest1365149-21cron08:10:003
1343738994126,9cyclictest311ktimers/209:40:112
1343735994132,5cyclictest0-21swapper/111:00:001
1343743993933,4cyclictest1364848-21kworker/u8:2+events_unbound08:28:123
1343730993932,4cyclictest1409280-21unixbench_singl10:15:240
1343743993831,5cyclictest1375029-21kworker/u8:0+events_unbound08:38:123
1343738993818,5cyclictest131rcu_preempt07:10:132
1343743993728,6cyclictest391ktimers/308:10:113
1343738993727,6cyclictest0-21swapper/207:40:012
1343730993727,6cyclictest0-21swapper/012:00:000
1343743993625,4cyclictest1430168-21kworker/u8:0+events_unbound11:18:433
1343743993618,11cyclictest1416357-21kworker/u8:1-flush-179:9610:42:173
134374399361,7cyclictest0-21swapper/307:50:123
1343735993627,5cyclictest0-21swapper/108:43:131
1343730993629,4cyclictest1402890-21cron09:59:590
1343730993628,4cyclictest0-21swapper/009:20:010
1343730993627,5cyclictest0-21swapper/012:35:240
1343730993625,6cyclictest0-21swapper/009:00:250
1343743993529,4cyclictest1404225-21kworker/u8:2+events_unbound10:03:283
1343743993528,4cyclictest0-21swapper/312:15:263
1343743993526,6cyclictest1432785-21tune2fs11:25:163
1343743993524,6cyclictest0-21swapper/307:20:243
1343743993517,10cyclictest131rcu_preempt10:15:213
1343735993527,4cyclictest0-21swapper/112:15:251
1343730993526,4cyclictest0-21swapper/007:30:010
1343730993525,6cyclictest0-21swapper/010:45:250
134373099351,31cyclictest0-21swapper/011:25:110
1343743993424,5cyclictest0-21swapper/310:58:403
1343743993423,7cyclictest0-21swapper/307:10:253
1343743993421,4cyclictest131rcu_preempt11:23:023
1343743993417,5cyclictest131rcu_preempt09:15:003
1343738993427,4cyclictest1430413-21sendmail11:20:012
1343738993427,4cyclictest1375392-21cron08:40:012
1343735993428,4cyclictest1416357-21kworker/u8:1+events_unbound10:53:401
1343735993427,4cyclictest0-21swapper/111:00:151
1343735993425,6cyclictest0-21swapper/110:35:011
1343735993424,7cyclictest1433612-21grep11:25:241
1343730993427,4cyclictest1373273-21unixbench_singl08:30:260
1343730993425,6cyclictest0-21swapper/012:13:530
1343730993425,5cyclictest0-21swapper/009:40:000
1343743993327,4cyclictest1362969-21unixbench_multi08:00:233
1343743993324,4cyclictest0-21swapper/307:35:013
1343743993323,6cyclictest0-21swapper/308:40:253
1343743993318,5cyclictest131rcu_preempt10:50:163
1343743993317,5cyclictest131rcu_preempt12:20:123
1343743993313,5cyclictest131rcu_preempt09:20:243
1343738993324,6cyclictest0-21swapper/210:00:002
1343738993313,5cyclictest131rcu_preempt09:30:192
1343735993324,5cyclictest0-21swapper/111:55:241
1343730993325,4cyclictest0-21swapper/010:10:280
1343730993325,4cyclictest0-21swapper/008:18:070
1343730993320,9cyclictest121ktimers/010:35:130
134374399329,7cyclictest131rcu_preempt10:05:103
1343743993223,7cyclictest1428443-21kworker/u8:1+events_unbound11:14:403
1343743993222,6cyclictest0-21swapper/311:50:003
1343743993220,4cyclictest131rcu_preempt07:19:563
1343743993213,11cyclictest131rcu_preempt12:25:173
1343743993213,11cyclictest0-21swapper/312:11:143
1343738993226,4cyclictest1347396-21kworker/u8:0+events_unbound07:22:562
1343738993226,3cyclictest0-21swapper/210:59:592
1343738993225,5cyclictest1366637-21kworker/u8:0+events_unbound08:12:432
134373899322,4cyclictest131rcu_preempt08:50:142
1343738993224,4cyclictest0-21swapper/212:10:002
1343738993224,4cyclictest0-21swapper/212:09:592
1343738993215,5cyclictest1416357-21kworker/u8:1+events_unbound10:46:442
1343735993225,4cyclictest1345528-21munin-node07:15:011
1343735993221,7cyclictest0-21swapper/112:00:271
1343735993221,7cyclictest0-21swapper/112:00:271
1343730993225,4cyclictest1354498-21cron07:40:000
1343730993222,6cyclictest0-21swapper/011:30:280
1343730993222,6cyclictest0-21swapper/011:05:240
134374399318,15cyclictest131rcu_preempt11:05:223
134374399318,10cyclictest1369799-21grep08:20:243
134374399312,8cyclictest0-21swapper/307:25:133
1343743993124,5cyclictest1426712-21kworker/u8:2+events_unbound11:50:403
1343743993123,4cyclictest0-21swapper/310:35:273
1343743993118,5cyclictest131rcu_preempt09:15:243
1343743993112,11cyclictest40-21ksoftirqd/309:30:013
1343743993110,11cyclictest40-21ksoftirqd/308:45:253
1343738993125,3cyclictest0-21swapper/211:00:242
1343738993124,5cyclictest1439139-21kworker/u8:1+events_unbound11:43:482
1343738993123,4cyclictest0-21swapper/212:10:282
1343738993120,7cyclictest1351102-21grep07:30:002
134373899311,5cyclictest0-21swapper/207:55:122
1343735993124,4cyclictest0-21swapper/108:05:171
1343735993120,8cyclictest231ktimers/111:15:141
1343730993121,6cyclictest1447627-21grep12:05:230
1343730993121,6cyclictest1447627-21grep12:05:230
134374399309,6cyclictest40-21ksoftirqd/310:25:153
134374399308,3cyclictest131rcu_preempt09:45:223
134374399308,3cyclictest131rcu_preempt09:45:223
134374399308,11cyclictest40-21ksoftirqd/310:25:013
134374399308,10cyclictest40-21ksoftirqd/309:05:163
134374399307,7cyclictest40-21ksoftirqd/308:50:063
1343743993024,4cyclictest1354364-21kworker/u8:3+events_unbound07:39:413
1343743993021,7cyclictest1437408-21kworker/u8:0+events_unbound11:38:373
1343743993017,5cyclictest131rcu_preempt11:30:223
1343743993015,4cyclictest131rcu_preempt10:49:513
1343743993015,4cyclictest131rcu_preempt09:35:233
1343743993014,7cyclictest1421610-21kworker/u8:0+events_unbound11:02:323
1343743993013,5cyclictest131rcu_preempt09:40:243
1343738993023,4cyclictest1406308-21cron10:10:002
1343738993022,4cyclictest0-21swapper/207:40:242
1343738993020,6cyclictest0-21swapper/210:40:242
134373899301,2cyclictest0-21swapper/207:45:122
1343730993019,5cyclictest1426712-21kworker/u8:2+events_unbound11:23:460
134373099301,5cyclictest131rcu_preempt09:45:110
134373099301,5cyclictest131rcu_preempt09:45:110
134374399299,12cyclictest40-21ksoftirqd/307:40:223
134374399297,13cyclictest40-21ksoftirqd/308:15:173
1343743992918,4cyclictest131rcu_preempt10:14:543
1343743992915,4cyclictest131rcu_preempt11:40:163
1343743992914,4cyclictest131rcu_preempt09:50:213
1343743992914,3cyclictest131rcu_preempt12:00:153
1343743992914,3cyclictest131rcu_preempt12:00:153
1343738992923,4cyclictest1451043-21unixbench_multi12:15:252
1343738992921,4cyclictest0-21swapper/208:00:232
1343738992913,11cyclictest311ktimers/208:55:162
1343735992922,4cyclictest0-21swapper/111:10:301
1343735992922,4cyclictest0-21swapper/109:30:171
1343735992921,4cyclictest0-21swapper/112:40:011
1343735992918,8cyclictest1437659-21sendmail11:40:001
1343735992917,8cyclictest1-21systemd07:53:011
1343730992922,4cyclictest1454926-21idleruntime-cro12:30:000
1343730992921,5cyclictest0-21swapper/011:40:000
1343730992921,5cyclictest0-21swapper/008:20:250
1343730992921,5cyclictest0-21swapper/008:10:250
1343730992921,4cyclictest0-21swapper/008:50:260
134374399289,5cyclictest131rcu_preempt07:55:233
134374399288,5cyclictest40-21ksoftirqd/307:50:013
1343743992817,8cyclictest1458327-21run-parts12:40:003
1343743992813,6cyclictest131rcu_preempt12:05:103
1343743992813,6cyclictest131rcu_preempt12:05:103
1343743992813,3cyclictest131rcu_preempt09:31:513
1343743992810,7cyclictest40-21ksoftirqd/312:30:193
1343738992824,2cyclictest1375029-21kworker/u8:0+events_unbound09:03:182
1343738992821,3cyclictest0-21swapper/211:54:592
1343738992817,6cyclictest0-21swapper/212:20:252
1343735992820,4cyclictest0-21swapper/110:10:001
134373099286,19cyclictest1346739-21/usr/sbin/munin07:15:200
1343730992821,4cyclictest0-21swapper/008:50:010
1343730992813,3cyclictest131rcu_preempt10:25:120
1343743992714,5cyclictest131rcu_preempt10:30:223
1343738992720,5cyclictest1421610-21kworker/u8:0+events_unbound11:08:422
1343738992720,3cyclictest0-21swapper/209:45:242
1343738992720,3cyclictest0-21swapper/209:45:242
1343738992718,5cyclictest0-21swapper/207:15:152
1343738992717,6cyclictest0-21swapper/211:30:272
134373899271,13cyclictest0-21swapper/211:25:112
134373599271,9cyclictest14014882sort09:55:141
1343730992720,5cyclictest1376862-21kworker/u8:2+events_unbound08:43:120
1343730992720,4cyclictest1410157-21cut10:20:170
1343730992719,5cyclictest0-21swapper/008:00:010
1343730992718,5cyclictest13550irq/42-30be0000.ethernet09:25:240
1343730992718,5cyclictest0-21swapper/008:35:240
1343738992619,5cyclictest1412921-21kworker/u8:0+events_unbound10:27:352
1343738992619,4cyclictest0-21swapper/209:25:252
1343738992618,6cyclictest1376862-21kworker/u8:2+events_unbound08:45:142
1343738992618,5cyclictest1432321-21sh11:25:002
1343738992618,4cyclictest0-21swapper/210:00:262
1343738992617,4cyclictest0-21swapper/210:35:152
1343738992616,7cyclictest1410974-21grep10:20:272
1343738992615,7cyclictest1409250-21grep10:15:252
1343738992612,7cyclictest32-21ksoftirqd/209:05:242
1343738992611,4cyclictest131rcu_preempt08:05:282
134373899261,13cyclictest0-21swapper/208:40:122
1343735992618,4cyclictest0-21swapper/110:20:181
1343735992617,6cyclictest0-21swapper/111:55:001
1343735992615,8cyclictest1435875-21cut11:35:001
1343730992618,5cyclictest1352788-21sh07:35:010
1343730992618,5cyclictest0-21swapper/010:30:300
1343730992618,5cyclictest0-21swapper/009:20:260
1343730992618,5cyclictest0-21swapper/007:15:000
1343730992618,4cyclictest0-21swapper/008:55:270
1343730992617,5cyclictest0-21swapper/012:20:000
1343730992617,5cyclictest0-21swapper/010:00:270
1343730992616,6cyclictest1364674-21grep08:05:270
1343738992518,5cyclictest1409473-21kworker/u8:1+events_unbound10:31:522
1343738992518,5cyclictest1407688-21kworker/u8:2+events_unbound10:13:542
1343738992518,5cyclictest1364848-21kworker/u8:2+events_unbound08:23:082
1343738992517,5cyclictest1454636-21kworker/u8:0+events_unbound12:37:412
1343738992517,5cyclictest0-21swapper/209:20:002
1343738992517,4cyclictest0-21swapper/211:55:152
1343738992513,7cyclictest1453630-21grep12:25:172
1343735992519,3cyclictest0-21swapper/108:25:011
1343735992518,3cyclictest0-21swapper/110:10:181
1343735992517,5cyclictest0-21swapper/108:55:271
1343735992517,5cyclictest0-21swapper/107:30:261
134373599251,5cyclictest1371524-21unixbench_multi08:25:241
1343730992519,4cyclictest1385862-21kworker/u8:2+events_unbound09:53:270
1343730992517,5cyclictest0-21swapper/011:50:210
1343730992517,5cyclictest0-21swapper/010:40:240
1343730992515,7cyclictest1424831-21unixbench_multi11:00:250
1343730992514,7cyclictest1385429-21grep09:05:260
1343738992418,4cyclictest1358046-21kworker/u8:1+events_unbound07:50:402
1343738992418,3cyclictest0-21swapper/212:30:212
1343738992418,3cyclictest0-21swapper/207:30:162
1343738992416,5cyclictest0-21swapper/209:50:292
1343738992412,10cyclictest32-21ksoftirqd/208:25:242
1343735992416,4cyclictest0-21swapper/107:40:251
1343735992415,7cyclictest1454919-21idleruntime-cro12:30:001
1343735992415,6cyclictest0-21swapper/107:50:011
1343730992417,4cyclictest0-21swapper/010:55:000
134373099241,5cyclictest131rcu_preempt07:20:130
1343730992414,6cyclictest0-21swapper/007:50:200
134373099241,19cyclictest0-21swapper/011:41:390
134373099241,19cyclictest0-21swapper/011:11:590
134373099241,19cyclictest0-21swapper/009:41:130
134373099240,20cyclictest0-21swapper/010:57:100
1343738992317,4cyclictest1437408-21kworker/u8:0+events_unbound11:38:482
1343738992317,4cyclictest1426712-21kworker/u8:2+events_unbound11:13:432
1343735992317,3cyclictest0-21swapper/109:00:211
1343735992315,4cyclictest0-21swapper/107:30:001
1343735992312,7cyclictest0-21swapper/109:25:001
1343730992316,5cyclictest1404225-21kworker/u8:2+events_unbound10:05:370
1343738992215,5cyclictest1370136-21kworker/u8:1+events_unbound08:31:252
1343735992215,3cyclictest0-21swapper/109:40:011
1343735992215,3cyclictest0-21swapper/108:35:001
134373099221,6cyclictest1371433-21cat08:25:250
1343730992215,5cyclictest1439139-21kworker/u8:1+events_unbound12:00:460
1343730992215,5cyclictest1439139-21kworker/u8:1+events_unbound12:00:450
1343730992214,5cyclictest1355113-21grep07:40:150
1343730992214,5cyclictest0-21swapper/012:20:230
1343730992212,7cyclictest1392912-21apt-get09:30:130
1343738992115,3cyclictest0-21swapper/209:10:142
1343738992115,3cyclictest0-21swapper/208:15:182
1343735992116,3cyclictest1345855-21fschecks_time07:15:031
1343735992115,3cyclictest0-21swapper/111:05:151
1343735992114,5cyclictest231ktimers/109:45:191
1343735992114,5cyclictest231ktimers/109:45:191
1343735992114,4cyclictest1439635-21latency_hist11:45:021
1343735992113,5cyclictest1343721-21cyclictest10:25:141
1343735992113,5cyclictest0-21swapper/112:10:291
1343735992113,5cyclictest0-21swapper/108:50:001
134373599211,13cyclictest0-21swapper/112:24:481
1343735992110,8cyclictest1379258-21apt-get08:50:131
134373899206,7cyclictest131rcu_preempt11:45:222
134373599209,8cyclictest1403238-21awk10:00:151
134373599206,10cyclictest1401055-21sshd09:53:251
1343735992012,4cyclictest0-21swapper/109:25:161
1343735992011,6cyclictest1374194-21/usr/sbin/munin08:35:181
1343735991912,5cyclictest231ktimers/112:30:201
1343735991912,5cyclictest231ktimers/109:05:151
1343735991912,3cyclictest0-21swapper/108:10:171
1343735991911,5cyclictest0-21swapper/111:45:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional