You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 23:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sat Jul 04, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
146925399328016,3259cyclictest1477619-21kworker/2:2+events19:35:172
146925799326116,3240cyclictest1486929-21kworker/3:0+events20:30:113
146924999323416,3214cyclictest1554116-21kworker/1:1+events23:35:181
146925799312215,3101cyclictest1515586-21kworker/3:2+events22:05:003
146925799311414,3096cyclictest1570650-21kworker/3:1+events00:30:103
146925399303315,3014cyclictest1515797-21kworker/2:1+events21:40:132
146924499299314,2973cyclictest1504406-21kworker/0:1+events21:00:120
146925799299214,2974cyclictest1473304-21kworker/3:0+events19:30:173
146925799298215,2964cyclictest1510857-21kworker/3:0+events21:30:023
146924999297314,2954cyclictest1506116-21kworker/1:1+events21:15:171
146924999289412,2878cyclictest1517394-21kworker/1:0+events21:45:111
146924999286310,2849cyclictest1557407-21kworker/1:0+events23:47:051
146924999286114,2843cyclictest1557407-21kworker/1:0+events00:05:211
146924999281713,2802cyclictest1538242-21kworker/1:0+events22:45:101
146924999281610,2802cyclictest1474001-21kworker/1:0+events19:25:201
146924499281613,2800cyclictest1562304-21kworker/0:0+events00:10:170
146925399281013,2793cyclictest1496585-21kworker/2:2+events20:42:382
146924999280612,2790cyclictest1546209-21kworker/1:1+events23:15:181
146925799280213,2785cyclictest1480745-21kworker/3:2+events19:45:493
146925799280013,2783cyclictest1525390-21kworker/3:0+events22:15:113
146925399280013,2783cyclictest1507563-21kworker/2:1+events21:08:502
146924999279612,2780cyclictest1470362-21kworker/1:1+events19:18:551
146925399278811,2773cyclictest1513841-21kworker/2:2+events21:32:222
146925799278713,2770cyclictest1486929-21kworker/3:0+events20:23:453
146925799278012,2764cyclictest1480745-21kworker/3:2+events19:55:143
146925799277913,2762cyclictest1473304-21kworker/3:0+events19:24:123
146925799276713,2750cyclictest1544605-21kworker/3:1+events23:11:273
146925799276713,2750cyclictest1486929-21kworker/3:0+events20:09:043
146924499276611,2753cyclictest1519170-21kworker/0:2+events21:50:080
146925799276513,2748cyclictest1536497-21kworker/3:2+events22:39:533
146925799276413,2747cyclictest1470331-21kworker/3:2+events19:29:303
146925799276111,2746cyclictest1486929-21kworker/3:0+events20:35:513
146925799276010,2746cyclictest1502716-21kworker/3:1+events21:13:433
146924999276013,2743cyclictest1572324-21kworker/1:2+events00:39:391
146924499276013,2743cyclictest1543130-21kworker/0:0+events23:11:510
146925799275813,2741cyclictest1547904-21kworker/3:2+events23:22:003
146924499275611,2741cyclictest1559054-21kworker/0:1+events23:58:090
146924999275512,2738cyclictest1488715-21kworker/1:1+events20:29:041
146925799275211,2738cyclictest1505998-21kworker/3:2+events21:19:513
146924499275213,2735cyclictest1515768-21kworker/0:0+events21:35:230
146924999275111,2736cyclictest1499535-21kworker/1:0+events20:46:041
146924999274913,2731cyclictest1475599-21kworker/1:2+events19:36:041
146924999274912,2733cyclictest1501205-21kworker/1:2+events20:50:431
14692499927479,2734cyclictest1546209-21kworker/1:1+events23:14:061
146924999274315,2724cyclictest1567211-21kworker/1:0+events00:17:121
146924999274013,2725cyclictest1485332-21kworker/1:1+events20:00:101
146924999273613,2721cyclictest1513813-21kworker/1:2+events21:35:031
146924999273613,2720cyclictest1557407-21kworker/1:0+events00:03:291
146924499273013,2714cyclictest1494835-21kworker/0:0+events20:31:420
146924499272613,2711cyclictest1480775-21kworker/0:0+events19:46:580
146925399272412,2708cyclictest1538155-21kworker/2:2+events22:48:132
146924499272412,2708cyclictest1543130-21kworker/0:0+events23:17:080
146924499272311,2708cyclictest1562304-21kworker/0:0+events00:00:480
146924499272311,2708cyclictest1482400-21kworker/0:2+events20:04:500
146924499272211,2707cyclictest1510552-21kworker/0:0+events21:19:280
146924999271813,2701cyclictest1513813-21kworker/1:2+events21:28:331
146925799271712,2701cyclictest1515586-21kworker/3:2+events21:36:093
146924499271713,2700cyclictest1472641-21kworker/0:0+events19:33:470
146924499271113,2696cyclictest1567122-21kworker/0:1+events00:17:580
146925799270813,2691cyclictest1488656-21kworker/3:1+events20:13:373
146925799269713,2680cyclictest1496439-21kworker/3:2+events20:45:183
146924499269213,2676cyclictest1477374-21kworker/0:1+events19:38:440
146924999268512,2669cyclictest1488715-21kworker/1:1+events20:21:081
146925799268213,2667cyclictest1525390-21kworker/3:0+events22:20:103
146924999268213,2665cyclictest1521895-21kworker/1:1+events21:51:411
146925799268013,2664cyclictest1533263-21kworker/3:1+events22:30:003
146925399267813,2661cyclictest1534084-21kworker/2:2+events22:35:172
146925799267413,2657cyclictest1477438-21kworker/3:1+events19:43:583
146925399267413,2658cyclictest1496585-21kworker/2:2+events20:50:202
146924499266713,2650cyclictest1554149-21kworker/0:0+events23:40:570
146925399266613,2649cyclictest1490108-21kworker/2:1+events20:14:242
146924999266412,2647cyclictest1494984-21kworker/1:0+events20:32:061
146925799266113,2644cyclictest1554452-21kworker/3:0+events23:38:383
146925399266113,2644cyclictest1520415-21kworker/2:0+events21:47:532
146924499266110,2647cyclictest1525331-21kworker/0:2+events22:15:550
146925799265813,2641cyclictest1542312-21kworker/3:2+events22:56:333
146925399265713,2640cyclictest1512154-21kworker/2:1+events21:23:432
146924499265513,2639cyclictest1496645-21kworker/0:2+events20:47:150
146925799265412,2639cyclictest1494802-21kworker/3:1+events20:27:303
146925399264013,2623cyclictest1491798-21kworker/2:0+events20:37:012
146924999262513,2609cyclictest1479158-21kworker/1:1+events19:41:421
146925399262413,2608cyclictest1498181-21kworker/2:1+events20:57:302
146924499262411,2609cyclictest1506057-21kworker/0:2+events21:12:580
146925399262113,2604cyclictest1504194-21kworker/2:0+events21:02:282
146925399262013,2603cyclictest1498181-21kworker/2:1+events20:46:512
146925399262012,2604cyclictest1567181-21kworker/2:2+events00:16:272
146924499261710,2603cyclictest1496645-21kworker/0:2+events20:39:130
146924999261112,2595cyclictest1487050-21kworker/1:2+events20:12:061
146925399260113,2584cyclictest1505939-21kworker/2:2+events21:15:422
146925399259112,2575cyclictest1488440-21kworker/2:0+events20:09:272
146924499259113,2574cyclictest1521989-21kworker/0:1+events22:11:490
146924499259113,2574cyclictest1521989-21kworker/0:1+events22:11:490
146925799258712,2571cyclictest1570650-21kworker/3:1+events00:25:383
146924499258612,2570cyclictest1472641-21kworker/0:0+events19:22:200
146925399258512,2569cyclictest1530280-21kworker/2:0+events23:10:422
146925399258212,2566cyclictest1560669-21kworker/2:0+events00:02:422
14692539925805,2572cyclictest1477619-21kworker/2:2+events19:53:462
146925399258012,2564cyclictest1522049-21kworker/2:1+events22:02:452
146925399257912,2563cyclictest1573743-21kworker/2:0+events00:33:352
146925399257912,2563cyclictest1568823-21kworker/2:1+events00:36:132
146925399257912,2563cyclictest1530280-21kworker/2:0+events23:03:282
146925399257912,2563cyclictest1517739-21kworker/2:2+events21:56:192
146925399257812,2562cyclictest1551067-21kworker/2:0+events23:23:342
146925399257812,2562cyclictest1512154-21kworker/2:1+events21:25:572
146925399257812,2562cyclictest1477619-21kworker/2:2+events19:42:252
146925399257712,2562cyclictest1536407-21kworker/2:1+events22:40:392
146924999257712,2561cyclictest1504450-21kworker/1:2+events21:03:361
146925399257410,2560cyclictest1555928-21kworker/2:2+events23:42:312
146925399257312,2557cyclictest1528646-21kworker/2:1+events22:15:322
146925799257213,2555cyclictest1544605-21kworker/3:1+events23:07:413
146925399257012,2554cyclictest1531961-21kworker/2:1+events22:27:422
146925399256912,2553cyclictest1477619-21kworker/2:2+events19:58:152
146924499256611,2551cyclictest1502804-21kworker/0:0+events21:05:510
146925399255512,2540cyclictest1472469-21kworker/2:1+events19:19:402
146925399255412,2539cyclictest1544962-21kworker/2:1+events23:07:182
146925799254713,2531cyclictest1515586-21kworker/3:2+events22:09:563
146925799254713,2531cyclictest1515586-21kworker/3:2+events22:09:553
146925399254710,2533cyclictest1509383-21kworker/2:0+events21:38:222
146925799254512,2530cyclictest1533263-21kworker/3:1+events22:34:553
146924999254411,2530cyclictest1483734-21kworker/1:0+events20:05:371
146925799254312,2527cyclictest1560401-21kworker/3:2+events23:56:123
14692539925426,2532cyclictest1477619-21kworker/2:2+events20:16:162
146925399254212,2527cyclictest1490108-21kworker/2:1+events20:25:372
146925799254112,2525cyclictest1544605-21kworker/3:1+events23:27:433
146924499254112,2525cyclictest1565430-21kworker/0:2+events00:09:300
146924499254111,2526cyclictest1496645-21kworker/0:2+events20:40:190
14692579925407,2530cyclictest1573596-21kworker/3:0+events00:35:063
146925799253811,2523cyclictest1512562-21kworker/3:1+events21:44:483
146924999253813,2521cyclictest1541732-21kworker/1:0+events23:02:411
14692579925365,2527cyclictest1477438-21kworker/3:1+events19:39:273
146925799253510,2521cyclictest1544605-21kworker/3:1+events23:44:003
146924499253512,2519cyclictest1535105-21kworker/0:0+events22:49:240
146925799253410,2520cyclictest1482371-21kworker/3:0+events19:52:133
14692579925339,2521cyclictest1536497-21kworker/3:2+events22:47:063
146925799253312,2518cyclictest1547904-21kworker/3:2+events23:17:313
146925799253312,2517cyclictest1502716-21kworker/3:1+events20:53:223
14692579925325,2523cyclictest1470796-21kworker/3:3+events19:16:383
146925799253211,2517cyclictest1504374-21kworker/3:0+events21:01:203
14692579925319,2518cyclictest1515586-21kworker/3:2+events21:55:323
146925799253112,2515cyclictest1542312-21kworker/3:2+events23:01:083
146925799253111,2516cyclictest1562004-21kworker/3:0+events00:01:103
146925799253012,2514cyclictest1562004-21kworker/3:0+events00:10:413
146925799252911,2514cyclictest1536497-21kworker/3:2+events22:43:403
146925799252812,2512cyclictest1515586-21kworker/3:2+events22:14:033
146925799252812,2512cyclictest1515586-21kworker/3:2+events22:14:033
14692499925287,2518cyclictest1525184-21kworker/1:2+events22:29:391
146924999252812,2512cyclictest1536619-21kworker/1:2+events22:44:021
14692579925278,2515cyclictest1562004-21kworker/3:0+events00:22:123
146925799252712,2511cyclictest1544605-21kworker/3:1+events23:52:453
146924999252711,2512cyclictest1528792-21kworker/1:1+events22:38:421
146924499252712,2511cyclictest1559054-21kworker/0:1+events23:49:200
146925399252412,2509cyclictest1530280-21kworker/2:0+events22:59:142
146924999252212,2506cyclictest1525184-21kworker/1:2+events22:10:191
146924999252212,2506cyclictest1525184-21kworker/1:2+events22:10:191
146924999252111,2506cyclictest1483734-21kworker/1:0+events19:54:291
146924999251910,2505cyclictest1546209-21kworker/1:1+events23:08:051
146924999251811,2503cyclictest1488715-21kworker/1:1+events20:18:301
146924999251712,2501cyclictest1557407-21kworker/1:0+events23:53:301
146924499251512,2499cyclictest1485210-21kworker/0:0+events20:07:530
14692499925148,2503cyclictest1562961-21kworker/1:2+events00:14:551
146924999251412,2498cyclictest1517394-21kworker/1:0+events21:43:141
146924999251412,2498cyclictest1512184-21kworker/1:0+events21:22:331
146924999251412,2498cyclictest1488715-21kworker/1:1+events20:43:011
146924999251212,2496cyclictest1475599-21kworker/1:2+events19:33:021
146924999251112,2495cyclictest1502865-21kworker/1:0+events21:06:361
146924999251111,2496cyclictest1535015-21kworker/1:0+events22:34:121
14692499925102,2504cyclictest1547992-21kworker/1:0+events23:34:091
146924999251012,2494cyclictest1483734-21kworker/1:0+events19:58:381
146924499251011,2495cyclictest1535105-21kworker/0:0+events22:40:160
14692579925097,2498cyclictest1502716-21kworker/3:1+events20:57:533
14692499925098,2497cyclictest1562961-21kworker/1:2+events00:22:581
146924499250912,2493cyclictest1538372-21kworker/0:1+events23:02:170
146924499250812,2492cyclictest1575374-21kworker/0:0+events00:39:160
146925399250712,2493cyclictest1491798-21kworker/2:0+events20:20:012
14692499925078,2495cyclictest1470362-21kworker/1:1+events19:21:581
146924999250712,2491cyclictest1536619-21kworker/1:2+events22:50:311
146924999250712,2491cyclictest1525184-21kworker/1:2+events22:19:461
146924999250611,2492cyclictest1521895-21kworker/1:1+events21:58:151
146924499250612,2491cyclictest1552546-21kworker/0:1+events23:34:330
146925799250512,2489cyclictest1510857-21kworker/3:0+events21:27:503
146924999250512,2489cyclictest1506116-21kworker/1:1+events21:11:501
146924999250511,2490cyclictest1525184-21kworker/1:2+events22:06:061
146924999250511,2490cyclictest1525184-21kworker/1:2+events22:06:061
146924499250512,2490cyclictest1517363-21kworker/0:1+events21:42:050
14692449925045,2495cyclictest1472641-21kworker/0:0+events19:26:060
146924499250411,2490cyclictest1569022-21kworker/0:3+events00:21:280
146924499250411,2489cyclictest1482400-21kworker/0:2+events19:50:450
146924499250311,2488cyclictest1502804-21kworker/0:0+events20:58:170
146924499250311,2488cyclictest1479131-21kworker/0:2+events19:40:350
14692449925027,2491cyclictest1538372-21kworker/0:1+events22:50:520
146925399249712,2481cyclictest1517739-21kworker/2:2+events21:52:512
146924499249612,2480cyclictest1559054-21kworker/0:1+events23:51:370
146924499249612,2480cyclictest1533443-21kworker/0:2+events22:36:250
146925399249512,2480cyclictest1525038-21kworker/2:0+events22:10:432
146925399249512,2480cyclictest1525038-21kworker/2:0+events22:10:422
146924499249512,2481cyclictest1541409-21kworker/0:2+events22:55:460
146924499249512,2479cyclictest1521989-21kworker/0:1+events22:23:100
146924499249411,2480cyclictest1521989-21kworker/0:1+events22:31:090
146924499249411,2480cyclictest1515768-21kworker/0:0+events21:57:060
146924499249212,2477cyclictest1554149-21kworker/0:0+events23:36:450
146924499249212,2476cyclictest1502804-21kworker/0:0+events20:54:070
146924499249211,2477cyclictest1513901-21kworker/0:2+events21:33:310
146925399249011,2476cyclictest1480626-21kworker/2:1+events19:45:272
146925399249010,2477cyclictest1530280-21kworker/2:0+events22:53:282
14692449924909,2477cyclictest1521989-21kworker/0:1+events22:28:290
146925799248912,2473cyclictest1486929-21kworker/3:0+events20:02:543
14692449924899,2476cyclictest1552546-21kworker/0:1+events23:27:190
146925399248812,2472cyclictest1525038-21kworker/2:0+events22:05:452
146925399248812,2472cyclictest1525038-21kworker/2:0+events22:05:452
146924499248710,2474cyclictest1515768-21kworker/0:0+events22:01:360
146925399248612,2471cyclictest1475570-21kworker/2:0+events19:34:342
146925399248612,2470cyclictest1552727-21kworker/2:2+events23:32:142
146925399248611,2472cyclictest1475570-21kworker/2:0+events19:28:012
146924999248612,2471cyclictest1567211-21kworker/1:0+events00:27:111
14692539924859,2473cyclictest1554313-21kworker/2:0+events23:39:252
146925399248511,2471cyclictest1530280-21kworker/2:0+events23:15:402
146924999248512,2471cyclictest1555748-21kworker/1:2+events23:40:101
146925799248311,2468cyclictest1515586-21kworker/3:2+events21:46:443
146924999248212,2467cyclictest1488715-21kworker/1:1+events20:57:061
146925399248111,2467cyclictest1560669-21kworker/2:0+events00:12:582
146924499247911,2464cyclictest1490286-21kworker/0:2+events20:20:450
146925399247612,2460cyclictest1565462-21kworker/2:1+events00:08:032
146925399246212,2446cyclictest1555928-21kworker/2:2+events23:46:412
146924499246210,2449cyclictest1510552-21kworker/0:0+events21:22:090
146925799245212,2436cyclictest1539788-21kworker/3:1+events22:52:453
146925799245012,2434cyclictest1505998-21kworker/3:2+events21:21:473
146924499245012,2434cyclictest1494835-21kworker/0:0+events20:27:540
146925799244912,2433cyclictest1565551-21kworker/3:1+events00:09:103
146924999244912,2433cyclictest1525184-21kworker/1:2+events22:24:191
146925799244812,2432cyclictest1544605-21kworker/3:1+events23:45:343
146924499244811,2434cyclictest1488563-21kworker/0:1+events20:11:450
146925799244711,2433cyclictest1520381-21kworker/3:0+events21:50:313
146925799244710,2434cyclictest1488656-21kworker/3:1+events20:19:173
146925799244312,2428cyclictest1468386-21kworker/3:0+events19:13:123
146925799244312,2427cyclictest1547904-21kworker/3:2+events23:33:233
146924999243512,2420cyclictest1572324-21kworker/1:2+events00:30:551
146924499243412,2418cyclictest1521989-21kworker/0:1+events22:07:390
146924499243412,2418cyclictest1521989-21kworker/0:1+events22:07:390
146924999243312,2419cyclictest1479158-21kworker/1:1+events19:45:051
146924999243211,2417cyclictest1552214-21kworker/1:2+events23:28:271
146924999242712,2412cyclictest1547992-21kworker/1:0+events23:24:191
146924999242512,2409cyclictest1539878-21kworker/1:1+events22:58:501
146924999242412,2408cyclictest1513813-21kworker/1:2+events21:32:001
146924999242412,2408cyclictest1497644-21kworker/1:2+events20:38:501
146924999242312,2409cyclictest1557407-21kworker/1:0+events23:55:021
146925399241912,2403cyclictest1530280-21kworker/2:0+events22:32:402
146924999241912,2403cyclictest1521895-21kworker/1:1+events22:03:521
146924499241812,2402cyclictest1543130-21kworker/0:0+events23:08:260
146924499241412,2399cyclictest1490286-21kworker/0:2+events20:16:380
146924499241312,2397cyclictest1460881-21kworker/0:2+events19:19:180
146925399241112,2395cyclictest1560669-21kworker/2:0+events23:59:162
146924499241011,2397cyclictest1515768-21kworker/0:0+events21:45:340
146924499240912,2394cyclictest1468684-21kworker/0:1+events19:14:210
146924499240711,2392cyclictest1512245-21kworker/0:1+events21:28:110
146925399240412,2388cyclictest1555928-21kworker/2:2+events23:54:162
146924499240412,2389cyclictest1567122-21kworker/0:1+events00:32:470
146924499239412,2379cyclictest1482400-21kworker/0:2+events19:55:360
146925399236010,2347cyclictest1568823-21kworker/2:1+events00:26:022
146925399232812,2313cyclictest1491798-21kworker/2:0+events20:34:232
146925799228410,2270cyclictest1567153-21kworker/3:2+events00:17:333
146924499227311,2259cyclictest1567122-21kworker/0:1+events00:26:470
146925399226510,2251cyclictest1470397-21kworker/2:2+events19:21:352
146925799223410,2220cyclictest1505998-21kworker/3:2+events21:07:433
14692449922217,2211cyclictest1543130-21kworker/0:0+events23:21:390
146925399212810,2115cyclictest1530280-21kworker/2:0+events22:24:422
146925399210411,2090cyclictest1477619-21kworker/2:2+events20:00:572
146925399209411,2080cyclictest1549384-21kworker/2:1+events23:28:492
146925399208911,2075cyclictest1468413-21kworker/2:0+events19:13:582
14692499920679,2055cyclictest1470362-21kworker/1:1+events19:12:271
14684912153108,26sleep10-21swapper/119:06:461
14685512148102,27sleep30-21swapper/319:07:323
14684802147109,22sleep00-21swapper/019:06:370
14684272141100,38sleep20-21swapper/219:05:592
1469253991811,5cyclictest1570838-21awk00:25:002
1469253991613,2cyclictest1505939-21kworker/2:2+events_freezable21:10:162
146925799159,4cyclictest1499826-21cron20:45:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional