You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 03:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Dec 23, 2025 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1366466995124,10cyclictest1429595-21/usr/sbin/munin22:10:153
1366466995120,10cyclictest1394800-21dpkg20:30:013
1366458995036,11cyclictest231ktimers/120:25:111
1366458995036,11cyclictest231ktimers/120:25:101
1366453994941,4cyclictest1370394-21cut19:20:010
1366462994735,8cyclictest1442892-21auditctl22:50:002
1366466994529,11cyclictest1440266-21/usr/sbin/munin22:40:203
1366462994535,6cyclictest1393186-21cut20:25:152
1366462994535,6cyclictest1393186-21cut20:25:152
1366453994535,6cyclictest1467445-21fschecks_time00:00:190
1366466994432,8cyclictest391ktimers/300:10:113
1366466994429,11cyclictest1443691-21/usr/sbin/munin22:50:213
1366466994428,11cyclictest1450290-21/usr/sbin/munin23:10:203
1366466994423,16cyclictest1366726-21df_inode19:10:143
1366453994433,7cyclictest1388966-21grep20:10:270
1366466994333,7cyclictest1460195-21apt-get23:40:143
1366466994328,10cyclictest1414445-21/usr/sbin/munin21:25:213
1366466994327,11cyclictest0-21swapper/322:55:143
1366462994334,6cyclictest1388968-21unixbench_singl20:10:272
1366466994233,6cyclictest391ktimers/323:25:123
1366466994233,6cyclictest391ktimers/323:25:113
1366466994228,9cyclictest1422631-21/usr/sbin/munin21:50:183
1366453994231,8cyclictest1480428-21grep00:35:290
1366453994231,7cyclictest1425608-21cron22:00:010
1366453994231,7cyclictest1425608-21cron22:00:010
1366466994128,10cyclictest1419480-21/usr/sbin/munin21:40:163
1366466994128,10cyclictest1389598-21/usr/sbin/munin20:15:123
1366466994124,11cyclictest0-21swapper/323:15:163
1366462994131,6cyclictest1480430-21unixbench_singl00:35:302
1366458994133,4cyclictest0-21swapper/122:55:001
1366453994130,6cyclictest0-21swapper/022:35:000
1366453994129,6cyclictest0-21swapper/020:45:010
1366466994031,6cyclictest1431179-21apt-get22:15:123
1366466994030,7cyclictest1465298-21apt-get23:55:163
1366466994029,7cyclictest1434841-21/usr/sbin/munin22:25:183
1366466994029,5cyclictest0-21swapper/319:37:373
1366466994028,9cyclictest1442026-21/usr/sbin/munin22:45:273
1366466994028,9cyclictest1386207-21/usr/sbin/munin20:05:143
1366466994027,8cyclictest1415899-21/usr/sbin/munin21:30:173
1366466994027,10cyclictest1374652-21/usr/sbin/munin19:30:233
1366466994027,10cyclictest1369478-21/usr/sbin/munin19:15:213
1366466994026,10cyclictest1448240-21sshd23:05:083
1366466994024,12cyclictest1476559-21/usr/sbin/munin00:25:243
1366466994020,15cyclictest1382782-21fschecks_time19:55:193
1366466994010,14cyclictest1437436-21runrttasks22:31:073
1366453994031,6cyclictest1371662-21unixbench_multi19:20:270
1366453994028,9cyclictest121ktimers/000:25:130
1366466993929,7cyclictest1420873-21/usr/sbin/munin21:45:163
1366466993928,7cyclictest1417453-21/usr/sbin/munin21:35:163
1366466993927,9cyclictest1453893-21/usr/sbin/munin23:20:213
1366466993927,9cyclictest1453893-21/usr/sbin/munin23:20:213
1366466993927,7cyclictest1412672-21/usr/sbin/munin21:20:193
1366466993927,7cyclictest1410938-21/usr/sbin/munin21:15:183
1366466993927,7cyclictest1393301-21/usr/sbin/munin20:25:153
1366466993927,7cyclictest1393301-21/usr/sbin/munin20:25:153
1366466993925,9cyclictest1463705-21/usr/sbin/munin23:50:153
1366466993925,10cyclictest1388027-21/usr/sbin/munin20:10:173
1366466993925,10cyclictest1372615-21/usr/sbin/munin19:25:183
1366466993924,12cyclictest1438633-21/usr/sbin/munin22:35:213
1366466993923,10cyclictest1424381-21/usr/sbin/munin21:55:173
1366466993923,10cyclictest1424381-21/usr/sbin/munin21:55:163
1366466993915,10cyclictest1458470-21/usr/sbin/munin23:35:163
1366462993932,4cyclictest1432773-21latency_hist22:20:012
1366466993832,3cyclictest1468931-21apt-get00:05:133
1366466993828,7cyclictest1467228-21/usr/sbin/munin00:00:143
1366466993828,7cyclictest1396748-21/usr/sbin/munin20:35:143
1366466993827,8cyclictest1370768-21/usr/sbin/munin19:20:183
1366466993827,7cyclictest1408930-21/usr/sbin/munin21:10:153
1366466993826,9cyclictest1447523-21/usr/sbin/munin23:00:253
1366466993825,8cyclictest1472662-21/usr/sbin/munin00:15:163
1366466993825,10cyclictest14570062sleep323:30:193
1366466993824,10cyclictest1478196-21/usr/sbin/munin00:30:223
1366466993823,12cyclictest1404513-21/usr/sbin/munin20:55:263
1366466993822,13cyclictest1378246-21ls19:40:223
1366462993831,5cyclictest1416924-21kworker/u8:3+events_unbound21:38:072
1366453993828,6cyclictest0-21swapper/019:45:250
1366453993827,8cyclictest121ktimers/023:50:150
1366466993731,3cyclictest1427568-21apt-get22:05:123
1366466993727,7cyclictest1474265-21apt-get00:20:133
1366466993726,7cyclictest1462010-21diskstats23:45:143
1366466993726,7cyclictest1391663-21irqstats20:20:183
1366466993723,9cyclictest1433169-21/usr/sbin/munin22:20:203
1366466993721,12cyclictest1384603-21df20:00:153
1366466993720,13cyclictest1480000-21wc00:35:263
1366462993727,6cyclictest0-21swapper/221:20:012
1366453993730,3cyclictest0-21swapper/021:50:270
1366453993729,4cyclictest0-21swapper/022:20:010
1366453993728,4cyclictest0-21swapper/022:00:260
1366453993728,4cyclictest0-21swapper/022:00:260
1366453993726,6cyclictest0-21swapper/019:35:270
1366466993627,6cyclictest1426540-21/usr/sbin/munin22:00:253
1366466993627,6cyclictest1426540-21/usr/sbin/munin22:00:243
1366466993627,6cyclictest0-21swapper/319:50:133
1366466993626,7cyclictest1406682-21cron21:03:003
1366466993626,7cyclictest1402065-21/usr/sbin/munin20:50:193
1366466993626,7cyclictest1400589-21/usr/sbin/munin20:45:203
1366466993626,6cyclictest1379499-21/usr/sbin/munin19:45:163
1366466993625,7cyclictest1407300-21/usr/sbin/munin21:05:163
1366462993629,4cyclictest1366447-21cyclictest21:50:012
1366462993628,4cyclictest0-21swapper/222:35:142
1366462993626,6cyclictest0-21swapper/200:05:262
1366462993624,7cyclictest1478696-21grep00:30:272
1366458993629,4cyclictest1475281-21unixbench_multi00:20:271
1366458993626,8cyclictest231ktimers/100:35:151
1366458993624,8cyclictest1457769-21grep23:30:261
1366458993624,7cyclictest0-21swapper/100:30:261
1366453993627,6cyclictest1448026-21munin-plugin-st23:05:000
1366453993625,7cyclictest0-21swapper/020:45:250
1366466993528,4cyclictest1398804-21meminfo20:40:203
1366462993526,6cyclictest1371691-21grep19:20:272
1366462993524,7cyclictest1416609-21grep21:30:252
1366458993529,3cyclictest0-21swapper/120:10:011
1366458993527,5cyclictest0-21swapper/122:20:001
1366458993526,5cyclictest0-21swapper/122:10:161
1366453993525,6cyclictest0-21swapper/021:30:260
1366453993524,6cyclictest0-21swapper/019:30:010
1366462993426,4cyclictest0-21swapper/221:40:152
1366462993425,5cyclictest0-21swapper/200:19:592
1366458993427,4cyclictest1459945-21sh23:39:591
1366458993426,5cyclictest1403218-21cron20:55:011
1366458993426,4cyclictest0-21swapper/121:30:251
1366458993423,8cyclictest1429233-21apt-key22:10:011
1366453993427,4cyclictest1459955-21sendmail23:39:590
1366453993424,6cyclictest1409854-21grep21:10:250
1366453993424,6cyclictest0-21swapper/019:40:240
1366462993325,4cyclictest0-21swapper/221:50:272
1366462993324,6cyclictest1409857-21unixbench_singl21:10:262
1366462993323,6cyclictest0-21swapper/222:10:012
1366462993322,7cyclictest1398124-21sendmail20:40:002
1366462993320,7cyclictest0-21swapper/220:50:282
1366458993322,7cyclictest1421778-21grep21:45:261
1366453993324,5cyclictest0-21swapper/019:15:010
1366453993323,7cyclictest1445843-21grep22:55:270
1366453993320,7cyclictest0-21swapper/022:10:240
1366462993226,4cyclictest1425616-21cron22:00:002
1366462993226,4cyclictest1425616-21cron22:00:002
1366462993224,5cyclictest1445845-21unixbench_multi22:55:282
1366462993222,6cyclictest1396395-21sh20:35:002
1366462993222,6cyclictest0-21swapper/223:40:002
1366462993221,8cyclictest311ktimers/219:45:122
1366458993223,6cyclictest0-21swapper/120:35:011
1366458993222,7cyclictest1369913-21grep19:15:251
1366453993225,4cyclictest2-21kthreadd20:40:010
1366453993222,7cyclictest1439374-21kworker/u8:1+events_unbound22:48:280
1366453993215,14cyclictest0-21swapper/020:30:000
1366453993215,14cyclictest0-21swapper/020:30:000
1366462993122,6cyclictest0-21swapper/220:05:272
1366462993122,5cyclictest0-21swapper/223:15:002
1366462993122,5cyclictest0-21swapper/222:25:272
1366458993123,5cyclictest0-21swapper/119:45:161
1366458993123,4cyclictest0-21swapper/119:20:181
1366453993123,4cyclictest0-21swapper/019:55:280
1366453993121,7cyclictest1472129-21ls00:15:000
1366453993119,8cyclictest1444591-21apt22:55:000
1366453993119,7cyclictest1421732-21grep21:45:260
1366462993022,4cyclictest0-21swapper/223:45:242
1366462993022,4cyclictest0-21swapper/222:00:282
1366462993022,4cyclictest0-21swapper/222:00:272
1366462993019,7cyclictest1399358-21grep20:40:252
1366458993023,5cyclictest231ktimers/120:35:131
1366458993021,5cyclictest1375934-21cut19:35:191
1366458993021,5cyclictest0-21swapper/123:50:271
1366458993020,6cyclictest0-21swapper/121:15:251
1366458993019,7cyclictest1409800-21grep21:10:251
1366453993023,4cyclictest1392791-21sh20:25:010
1366453993021,6cyclictest0-21swapper/021:40:010
1366462992922,3cyclictest0-21swapper/223:30:262
1366462992921,5cyclictest1413417-21kworker/u8:2+events_unbound21:23:042
1366462992921,4cyclictest0-21swapper/220:15:152
1366462992921,4cyclictest0-21swapper/220:00:272
1366462992919,6cyclictest0-21swapper/220:00:002
1366462992916,8cyclictest204-21dbus-daemon22:53:282
1366458992922,4cyclictest0-21swapper/120:15:011
1366458992921,4cyclictest0-21swapper/100:15:271
1366458992919,7cyclictest1472090-21sh00:15:011
1366458992919,6cyclictest0-21swapper/123:05:181
1366458992918,7cyclictest0-21swapper/123:25:251
1366458992918,7cyclictest0-21swapper/123:25:241
1366453992922,4cyclictest0-21swapper/021:30:010
1366453992922,3cyclictest0-21swapper/021:00:260
1366453992921,4cyclictest0-21swapper/022:20:190
1366453992920,5cyclictest1469924-21grep00:05:250
1366453992919,6cyclictest0-21swapper/023:55:280
1366453992919,6cyclictest0-21swapper/023:45:240
1366453992919,6cyclictest0-21swapper/023:05:270
1366453992918,7cyclictest1412377-21grep21:20:150
1366462992820,4cyclictest0-21swapper/223:20:272
1366462992820,4cyclictest0-21swapper/223:20:262
1366462992820,4cyclictest0-21swapper/219:30:182
1366462992819,6cyclictest0-21swapper/200:20:272
1366462992816,9cyclictest1376805-21grep19:35:282
1366458992821,5cyclictest1451112-21kworker/u8:0+events_unbound23:13:331
1366458992820,4cyclictest0-21swapper/120:00:171
1366458992818,6cyclictest0-21swapper/123:55:271
1366453992821,5cyclictest1470286-21kworker/u8:1+events_unbound00:23:500
1366453992821,3cyclictest0-21swapper/020:15:160
1366453992818,6cyclictest0-21swapper/023:10:270
1366462992720,4cyclictest0-21swapper/223:55:002
1366462992719,4cyclictest0-21swapper/221:00:252
1366458992719,6cyclictest1415215-21kworker/u8:0+events_unbound22:03:121
1366458992719,6cyclictest1415215-21kworker/u8:0+events_unbound22:03:121
1366458992719,4cyclictest0-21swapper/119:30:231
1366453992718,5cyclictest0-21swapper/023:20:260
1366453992718,5cyclictest0-21swapper/023:20:260
1366453992718,5cyclictest0-21swapper/000:15:260
1366462992618,4cyclictest0-21swapper/220:45:262
1366462992618,4cyclictest0-21swapper/219:15:252
1366458992619,5cyclictest1466553-21kworker/u8:0+events_unbound00:08:471
1366458992619,4cyclictest1367646-21head19:10:261
1366458992618,4cyclictest0-21swapper/121:20:251
136645899261,7cyclictest14533192grep23:20:001
1366458992615,8cyclictest1373343-21grep19:25:251
1366458992613,9cyclictest204-21dbus-daemon22:58:291
1366453992620,4cyclictest0-21swapper/023:40:270
1366453992620,3cyclictest0-21swapper/022:40:260
1366453992613,8cyclictest1402792-21grep20:50:270
1366453992611,3cyclictest0-21swapper/023:20:000
1366462992514,8cyclictest1447111-21ntp_states23:00:222
1366458992519,3cyclictest0-21swapper/122:30:171
1366458992518,4cyclictest0-21swapper/100:25:241
1366458992518,3cyclictest0-21swapper/119:45:021
1366453992519,3cyclictest13850irq/36-mmc123:34:590
1366453992518,5cyclictest1418725-21kworker/u8:1+events_unbound21:43:070
1366453992518,3cyclictest0-21swapper/020:30:200
1366453992514,8cyclictest1386721-21awk20:05:210
1366462992418,3cyclictest0-21swapper/219:10:202
1366462992417,4cyclictest0-21swapper/222:20:282
1366462992416,5cyclictest0-21swapper/221:25:232
1366462992416,5cyclictest0-21swapper/200:25:262
1366462992414,7cyclictest1449345-21seq23:05:392
1366462992414,6cyclictest1405142-21sh21:00:002
1366458992417,4cyclictest0-21swapper/121:35:241
1366458992415,5cyclictest231ktimers/123:00:181
1366458992413,7cyclictest0-21swapper/121:05:241
1366453992417,4cyclictest0-21swapper/021:10:010
1366453992417,3cyclictest0-21swapper/020:00:250
1366453992414,7cyclictest1375455-21seq19:34:250
136645399241,19cyclictest0-21swapper/019:52:030
1366462992317,3cyclictest0-21swapper/222:15:012
1366462992316,5cyclictest1373562-21kworker/u8:0+events_unbound19:28:502
1366462992314,5cyclictest0-21swapper/200:15:002
1366462992313,7cyclictest1460295-21ls23:40:162
1366462992313,7cyclictest1455977-21expr23:25:232
1366462992313,7cyclictest1455977-21expr23:25:232
1366458992317,4cyclictest1451112-21kworker/u8:0+events_unbound23:23:361
1366458992317,4cyclictest1451112-21kworker/u8:0+events_unbound23:23:351
1366458992315,5cyclictest1461656-21auditctl23:45:001
1366458992314,6cyclictest1420059-21grep21:40:231
1366458992314,6cyclictest1414139-21uniq21:25:181
1366458992313,7cyclictest1462740-21cat23:45:241
136645899231,17cyclictest1384067-21awk20:00:011
136645399238,11cyclictest121ktimers/000:30:260
1366453992317,2cyclictest0-21swapper/022:25:540
1366453992315,5cyclictest1402845-21kworker/u8:1+events_unbound20:55:060
1366453992315,5cyclictest0-21swapper/023:25:230
1366453992315,5cyclictest0-21swapper/023:25:230
1366462992215,4cyclictest0-21swapper/221:05:202
1366462992214,5cyclictest1452651-21grep23:15:282
1366462992214,5cyclictest0-21swapper/200:00:262
1366458992217,3cyclictest0-21swapper/121:55:241
1366458992217,3cyclictest0-21swapper/121:55:231
1366458992216,3cyclictest0-21swapper/100:00:191
1366458992215,4cyclictest0-21swapper/120:45:251
1366458992215,3cyclictest0-21swapper/122:40:161
136645899221,17cyclictest1422453-21chrt21:50:151
136645899221,11cyclictest0-21swapper/120:16:321
1366453992217,2cyclictest0-21swapper/022:10:000
136645399220,19cyclictest0-21swapper/022:36:440
1366462992115,3cyclictest0-21swapper/219:40:132
1366462992114,3cyclictest0-21swapper/222:30:172
1366462992112,6cyclictest1440715-21awk22:40:252
136645899212,13cyclictest1399388-21grep20:40:251
1366458992115,4cyclictest1391483-21fschecks_count20:20:161
1366458992114,3cyclictest0-21swapper/121:00:231
1366458992114,3cyclictest0-21swapper/119:50:161
1366458992112,6cyclictest0-21swapper/122:20:191
1366462992014,4cyclictest311ktimers/220:22:202
136645899202,12cyclictest1436064-21cron22:30:001
1366458992014,3cyclictest0-21swapper/122:45:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional