You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-21 - 16:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Tue Oct 21, 2025 12:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
910733991310,2cyclictest0-21swapper/309:00:133
91073399128,3cyclictest933530-21taskset08:05:053
91073399120,8cyclictest0-21swapper/308:10:143
91073399120,11cyclictest69450irq/121-eno108:45:363
91073399120,11cyclictest0-21swapper/312:20:203
91073399120,11cyclictest0-21swapper/309:50:113
91073399120,11cyclictest0-21swapper/308:00:013
91073399120,10cyclictest0-21swapper/308:40:123
91073399117,1cyclictest0-21swapper/307:10:133
91073399111,0cyclictest0-21swapper/311:05:193
910733991110,1cyclictest69450irq/121-eno111:20:133
910733991110,0cyclictest0-21swapper/311:00:113
910733991110,0cyclictest0-21swapper/307:45:003
91073399110,9cyclictest0-21swapper/311:10:133
91073399110,10cyclictest69450irq/121-eno112:05:213
91073399110,10cyclictest69450irq/121-eno110:06:293
91073399110,10cyclictest0-21swapper/311:31:153
91073399110,10cyclictest0-21swapper/310:45:183
91073399110,10cyclictest0-21swapper/309:29:563
91073399110,10cyclictest0-21swapper/307:20:183
91073399110,0cyclictest0-21swapper/309:50:023
91073399109,1cyclictest69450irq/121-eno108:29:473
910733991010,0cyclictest69450irq/121-eno112:17:483
910733991010,0cyclictest69450irq/121-eno111:18:483
910733991010,0cyclictest69450irq/121-eno109:10:243
910733991010,0cyclictest69450irq/121-eno108:50:323
910733991010,0cyclictest69450irq/121-eno107:19:393
910733991010,0cyclictest0-21swapper/312:30:203
910733991010,0cyclictest0-21swapper/312:00:193
910733991010,0cyclictest0-21swapper/310:55:153
910733991010,0cyclictest0-21swapper/309:15:113
910733991010,0cyclictest0-21swapper/308:35:143
910733991010,0cyclictest0-21swapper/307:25:163
91073399100,9cyclictest69450irq/121-eno110:43:393
91073399100,0cyclictest0-21swapper/312:25:153
91073399100,0cyclictest0-21swapper/308:00:123
91073399100,0cyclictest0-21swapper/307:35:273
9107339999,0cyclictest69450irq/121-eno111:46:033
9107339999,0cyclictest69450irq/121-eno110:30:083
9107339999,0cyclictest69450irq/121-eno110:25:173
9107339999,0cyclictest69450irq/121-eno109:20:153
9107339999,0cyclictest0-21swapper/310:20:143
9107339999,0cyclictest0-21swapper/308:55:173
9107339998,1cyclictest69450irq/121-eno112:10:143
9107339990,8cyclictest69450irq/121-eno111:36:263
9107339990,8cyclictest69450irq/121-eno110:35:163
9107339990,8cyclictest69450irq/121-eno109:40:103
9107339988,0cyclictest69450irq/121-eno110:15:173
9107339988,0cyclictest69450irq/121-eno110:10:583
9107339988,0cyclictest69450irq/121-eno109:55:153
9107339988,0cyclictest69450irq/121-eno107:48:423
9107339988,0cyclictest0-21swapper/309:30:163
9107339988,0cyclictest0-21swapper/307:50:193
9107339987,1cyclictest69450irq/121-eno110:52:483
9107339980,7cyclictest69450irq/121-eno111:40:173
9107339980,7cyclictest0-21swapper/311:56:033
9107339977,0cyclictest69450irq/121-eno110:00:213
9107339977,0cyclictest69450irq/121-eno108:32:183
9107339977,0cyclictest69450irq/121-eno108:24:183
9107339977,0cyclictest0-21swapper/307:30:113
9107339970,6cyclictest0-21swapper/312:35:153
961466260,1sleep0961631-21memory09:15:150
9107339966,0cyclictest69450irq/121-eno111:25:473
9107339966,0cyclictest0-21swapper/309:35:153
9107339966,0cyclictest0-21swapper/308:15:193
9107339960,5cyclictest69450irq/121-eno111:50:203
9107339954,1cyclictest69450irq/121-eno109:05:463
908915250,3sleep30-21swapper/307:05:143
989388240,0sleep20-21swapper/210:21:262
909368241,1sleep20-21swapper/207:05:182
1016708240,3sleep21016710-21ssh11:25:262
910166231,1sleep00-21swapper/007:05:320
908849231,1sleep10-21swapper/107:05:091
1006764230,1sleep21006783-21munin-run11:05:002
999395220,1sleep1999473-21cut10:45:181
991421220,0sleep00-21swapper/010:25:560
989597220,0sleep00-21swapper/010:23:160
985351220,1sleep00-21swapper/010:12:470
981873220,1sleep10-21swapper/110:05:161
980242220,1sleep2980385-21timerandwakeup10:00:202
974665222,0sleep00-21swapper/009:48:090
969434220,1sleep00-21swapper/009:35:180
959442220,1sleep1959524-21irqstats09:10:201
956835220,1sleep2956871-21munin-run09:05:012
955338220,1sleep1955604-21diskstats09:00:151
951324220,1sleep2951350-21apt-get08:50:132
941213220,1sleep0941239-21apt-get08:25:130
936249220,1sleep0936420-21python308:10:190
935204220,1sleep1935210-21latency_hist08:10:001
929347220,0sleep00-21swapper/007:55:140
1046458220,1sleep21046460-21ssh12:36:542
1044672220,0sleep20-21swapper/212:34:342
1043372220,1sleep11043532-21sed12:30:171
1041421220,1sleep01041575-21ntp_states12:25:190
1038007220,1sleep00-21swapper/012:16:200
1037302220,1sleep21036593-21/usr/sbin/munin12:15:172
1036076220,1sleep20-21swapper/212:15:012
1027953220,1sleep10-21swapper/111:55:111
1016974222,0sleep00-21swapper/011:27:440
1009108220,1sleep21009134-21apt-get11:10:132
1003811220,1sleep00-21swapper/010:55:220
1002045220,1sleep00-21swapper/010:50:210
998846210,0sleep20-21swapper/210:45:152
996761210,0sleep20-21swapper/210:40:152
996038210,0sleep00-21swapper/010:40:020
995525210,0sleep20-21swapper/210:35:222
994663210,0sleep00-21swapper/010:35:160
993446210,0sleep20-21swapper/210:30:222
993437210,0sleep10-21swapper/110:30:211
993186210,0sleep00-21swapper/010:30:200
991393210,0sleep20-21swapper/210:25:432
989797210,0sleep10-21swapper/110:25:021
989710210,0sleep10-21swapper/110:24:171
987309210,0sleep10-21swapper/110:16:401
986663210,0sleep00-21swapper/010:15:190
986470210,0sleep20-21swapper/210:15:172
983901210,0sleep20-21swapper/210:10:182
981665210,0sleep20-21swapper/210:05:052
981405210,0sleep00-21swapper/010:05:030
979472210,0sleep10-21swapper/110:00:161
979397210,0sleep00-21swapper/010:00:150
978574210,0sleep10-21swapper/109:55:471
977351210,0sleep20-21swapper/209:55:162
976969210,0sleep00-21swapper/009:55:020
975136210,0sleep20-21swapper/209:50:122
975116210,0sleep00-21swapper/009:50:060
973313210,0sleep10-21swapper/109:45:181
973071210,0sleep20-21swapper/209:45:162
971506210,0sleep00-21swapper/009:40:170
971157210,0sleep20-21swapper/209:40:152
970778210,0sleep10-21swapper/109:40:021
970421210,0sleep20-21swapper/209:36:472
968999210,0sleep10-21swapper/109:35:141
968452210,0sleep00-21swapper/009:32:000
966737210,0sleep10-21swapper/109:30:011
965266210,0sleep00-21swapper/009:25:160
964980210,0sleep10-21swapper/109:25:131
964965210,0sleep20-21swapper/209:25:062
963165210,0sleep00-21swapper/009:20:170
961632210,0sleep10-21swapper/109:15:161
961149210,0sleep20-21swapper/209:15:132
960366210,1sleep20-21swapper/209:11:012
959194210,0sleep00-21swapper/009:10:190
957840210,0sleep00-21swapper/009:05:190
957528210,0sleep20-21swapper/209:05:182
957369210,0sleep10-21swapper/109:05:171
955890210,0sleep00-21swapper/009:00:180
954891210,0sleep20-21swapper/208:59:562
954035210,0sleep00-21swapper/008:55:180
952118210,0sleep10-21swapper/108:50:351
951467210,0sleep00-21swapper/008:50:300
950469210,0sleep20-21swapper/208:45:362
950294210,0sleep10-21swapper/108:45:351
948905210,0sleep00-21swapper/008:45:020
948010210,0sleep10-21swapper/108:40:181
947855210,0sleep00-21swapper/008:40:180
947225210,1sleep20-21swapper/208:40:032
946344210,0sleep00-21swapper/008:35:250
945485210,0sleep20-21swapper/208:35:192
945300210,0sleep10-21swapper/108:35:181
944089210,0sleep00-21swapper/008:30:210
943157210,0sleep20-21swapper/208:30:152
943128210,0sleep10-21swapper/108:30:141
940967210,0sleep10-21swapper/108:25:021
940584210,0sleep20-21swapper/208:20:222
939536210,0sleep00-21swapper/008:20:160
939032210,0sleep10-21swapper/108:20:011
937816210,0sleep20-21swapper/208:15:182
937117210,0sleep10-21swapper/108:15:011
935980210,0sleep20-21swapper/208:10:182
934610210,1sleep00-21swapper/008:05:190
933272210,0sleep20-21swapper/208:05:052
932297210,0sleep00-21swapper/008:00:200
931858210,0sleep10-21swapper/108:00:161
930834210,0sleep20-21swapper/208:00:012
930833210,0sleep10-21swapper/108:00:001
929169210,0sleep20-21swapper/207:55:122
927680210,0sleep10-21swapper/107:50:151
927409210,0sleep00-21swapper/007:50:140
926137210,0sleep20-21swapper/207:45:212
924334210,0sleep00-21swapper/007:40:220
923884210,0sleep10-21swapper/107:40:191
922570210,0sleep00-21swapper/007:35:290
921559210,0sleep20-21swapper/207:35:232
920963210,0sleep20-21swapper/207:32:442
919478210,0sleep10-21swapper/107:30:101
918971210,0sleep00-21swapper/007:30:010
918099210,0sleep10-21swapper/107:25:181
918015210,0sleep00-21swapper/007:25:170
916954210,0sleep10-21swapper/107:23:471
916831210,1sleep00-21swapper/007:22:090
916104210,0sleep20-21swapper/207:20:182
914786210,0sleep20-21swapper/207:15:462
913643210,0sleep00-21swapper/007:15:160
912747210,0sleep10-21swapper/107:15:011
911267210,0sleep00-21swapper/007:10:160
911081210,0sleep10-21swapper/107:10:131
1045783210,0sleep10-21swapper/112:35:211
1045042210,0sleep00-21swapper/012:35:160
1044283210,1sleep00-21swapper/012:31:080
1040385210,0sleep00-21swapper/012:23:390
1038942210,0sleep10-21swapper/112:20:161
1038430210,0sleep20-21swapper/212:20:012
1036592210,0sleep10-21swapper/112:15:121
1034609210,0sleep10-21swapper/112:10:151
1034335210,0sleep00-21swapper/012:10:140
1033450210,0sleep00-21swapper/012:05:220
1033118210,0sleep20-21swapper/212:05:202
1032947210,0sleep10-21swapper/112:05:191
1031043210,0sleep00-21swapper/012:00:230
1030597210,0sleep10-21swapper/112:00:201
1030140210,0sleep20-21swapper/212:00:162
1029284210,0sleep20-21swapper/211:55:362
1028918210,0sleep00-21swapper/011:55:180
1027276210,0sleep20-21swapper/211:51:152
1026482210,0sleep00-21swapper/011:50:170
1025856210,0sleep10-21swapper/111:50:061
1024300210,0sleep10-21swapper/111:45:191
1023871210,0sleep20-21swapper/211:45:162
1023526210,0sleep00-21swapper/011:45:010
1023013210,0sleep00-21swapper/011:40:330
1021814210,0sleep20-21swapper/211:40:152
1020929210,0sleep00-21swapper/011:35:440
1020907210,0sleep10-21swapper/111:35:331
1019583210,0sleep20-21swapper/211:35:142
1019158210,0sleep20-21swapper/211:33:352
1018289210,0sleep10-21swapper/111:30:211
1018207210,0sleep00-21swapper/011:30:200
1015145210,0sleep11015377-21latency_hist11:25:011
1014891210,0sleep10-21swapper/111:22:481
1013576210,0sleep00-21swapper/011:20:160
1013331210,0sleep20-21swapper/211:20:132
1012585210,0sleep10-21swapper/111:16:041
1011201210,0sleep20-21swapper/211:15:132
1009540210,0sleep10-21swapper/111:10:161
1009263210,0sleep00-21swapper/011:10:150
1007994210,0sleep20-21swapper/211:05:212
1007061210,0sleep00-21swapper/011:05:140
1007009210,0sleep10-21swapper/111:05:081
1005185210,0sleep00-21swapper/011:00:140
1004928210,0sleep10-21swapper/111:00:111
1002813210,0sleep20-21swapper/210:55:082
1002059210,0sleep10-21swapper/110:50:221
1001154210,0sleep20-21swapper/210:50:162
1000149210,0sleep00-21swapper/010:46:570
996555200,0sleep10-21swapper/110:40:031
994195200,0sleep10-21swapper/110:35:011
983753200,0sleep10-21swapper/110:10:041
975112200,0sleep10-21swapper/109:50:031
966974200,0sleep20-21swapper/209:30:032
962994200,0sleep10-21swapper/109:20:061
962734200,0sleep20-21swapper/209:20:022
953226200,0sleep10-21swapper/108:55:031
941200200,0sleep20-21swapper/208:25:032
937353200,0sleep00-21swapper/008:15:040
935441200,0sleep10-21swapper/108:10:041
927245200,0sleep20-21swapper/207:50:042
925331200,0sleep10-21swapper/107:45:041
925330200,0sleep00-21swapper/007:45:020
923419200,0sleep20-21swapper/207:40:042
921382200,0sleep10-21swapper/107:35:021
917293200,0sleep20-21swapper/207:25:032
911067200,0sleep20-21swapper/207:10:022
1040782200,0sleep10-21swapper/112:25:041
1040546200,0sleep20-21swapper/212:25:022
1021467200,0sleep10-21swapper/111:40:021
1011181200,0sleep00-21swapper/011:15:030
1002807200,0sleep10-21swapper/110:55:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional