You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 06:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Nov 29, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1033189995445,5cyclictest1087888-21munin-plugin-st21:45:002
1033193995042,5cyclictest1035006-21grep19:15:013
1033193994734,10cyclictest391ktimers/321:05:133
1033193994734,10cyclictest391ktimers/321:05:123
1033189994633,9cyclictest311ktimers/221:10:112
1033189994531,10cyclictest1100039-21sendmail22:20:012
1033189994437,5cyclictest1091395-21kworker/u8:2+events_unbound22:22:442
1033180994437,4cyclictest1113655-21sendmail23:00:000
1033189994234,5cyclictest1101612-21kworker/u8:1+events_unbound22:27:452
1033189994230,8cyclictest1147935-21grep00:35:272
1033180994233,5cyclictest1145003-21munin-plugin-st00:30:000
1033189994131,8cyclictest1125479-21kworker/u8:2+events_unbound23:35:142
1033184994129,8cyclictest1148417-21sendmail00:40:001
1033193993931,5cyclictest1141375-21sendmail00:20:003
1033193993931,5cyclictest1141375-21sendmail00:20:003
1033193993930,5cyclictest0-21swapper/321:32:333
1033189993931,4cyclictest0-21swapper/200:05:162
1033184993931,5cyclictest1071974-21kworker/u8:2+events_unbound20:57:261
1033189993828,7cyclictest1120216-21grep23:15:242
1033189993823,5cyclictest0-21swapper/200:28:432
1033184993830,4cyclictest0-21swapper/121:35:181
1033193993729,4cyclictest1065468-21cron20:40:003
1033189993729,4cyclictest0-21swapper/219:20:162
1033189993728,4cyclictest0-21swapper/200:35:002
1033189993727,6cyclictest0-21swapper/223:50:002
1033180993723,7cyclictest0-21swapper/000:05:240
1033193993628,4cyclictest0-21swapper/319:27:123
1033193993627,5cyclictest0-21swapper/322:47:483
1033193993627,4cyclictest0-21swapper/323:40:263
103318999368,17cyclictest32-21ksoftirqd/223:50:152
1033189993630,4cyclictest1034544-21kworker/u8:2+events_unbound19:12:112
1033189993628,5cyclictest1106847-21idleruntime-cro22:40:012
1033189993626,5cyclictest0-21swapper/221:00:252
1033184993627,5cyclictest0-21swapper/121:30:161
1033184993627,4cyclictest0-21swapper/122:50:211
1033180993627,6cyclictest1051188-21sh20:00:010
103318999354,6cyclictest0-21swapper/222:40:122
1033189993529,4cyclictest1071974-21kworker/u8:2+events_unbound20:57:302
1033189993524,8cyclictest1079322-21latency_hist21:20:012
1033189993523,7cyclictest0-21swapper/220:02:182
1033189993522,9cyclictest1122817-21seq23:25:162
1033189993518,6cyclictest1049023-21kworker/u8:2+events_unbound20:25:422
1033184993526,4cyclictest0-21swapper/121:15:251
1033184993524,7cyclictest0-21swapper/100:20:251
1033180993528,3cyclictest0-21swapper/000:40:000
1033180993526,6cyclictest1103015-21unixbench_singl22:25:250
1033180993525,6cyclictest0-21swapper/022:10:180
1033180993525,6cyclictest0-21swapper/000:15:260
1033180993525,6cyclictest0-21swapper/000:15:260
1033180993523,7cyclictest0-21swapper/021:20:250
1033193993426,4cyclictest0-21swapper/320:10:273
1033193993425,6cyclictest1116869-21unixbench_singl23:05:263
1033189993426,4cyclictest0-21swapper/220:40:152
1033189993426,4cyclictest0-21swapper/200:25:002
1033189993424,7cyclictest1081050-21sh21:25:002
1033189993423,7cyclictest0-21swapper/200:19:592
1033189993423,7cyclictest0-21swapper/200:19:592
1033184993424,6cyclictest0-21swapper/120:00:001
1033184993424,6cyclictest0-21swapper/119:45:011
1033184993423,7cyclictest0-21swapper/121:25:251
1033180993424,6cyclictest0-21swapper/023:50:260
1033180993423,8cyclictest0-21swapper/021:35:010
1033180993423,7cyclictest0-21swapper/023:55:250
1033180993423,6cyclictest0-21swapper/000:00:260
1033193993326,4cyclictest1068899-21idleruntime-cro20:50:013
1033193993325,4cyclictest0-21swapper/319:50:283
1033189993310,7cyclictest131rcu_preempt21:30:122
1033184993327,4cyclictest1061722-21kworker/u8:3+events_unbound20:32:231
1033184993325,4cyclictest0-21swapper/123:00:001
1033184993325,4cyclictest0-21swapper/122:35:161
1033184993325,4cyclictest0-21swapper/120:40:261
1033184993322,6cyclictest0-21swapper/120:50:251
1033180993322,6cyclictest0-21swapper/021:15:260
1033180993322,6cyclictest0-21swapper/019:15:010
1033180993321,7cyclictest0-21swapper/021:10:250
1033193993224,4cyclictest0-21swapper/323:00:003
103318999322,4cyclictest0-21swapper/219:45:122
1033189993223,5cyclictest0-21swapper/220:10:272
1033189993218,5cyclictest1066977-21kworker/u8:2+events_unbound20:46:022
1033189993217,9cyclictest131rcu_preempt23:55:182
1033184993225,4cyclictest1139653-21cron00:15:001
1033184993225,4cyclictest0-21swapper/120:00:241
1033184993224,4cyclictest1054823-21apt20:10:011
1033184993222,7cyclictest1086617-21fschecks_time21:40:171
1033184993221,8cyclictest1141371-21sendmail00:20:001
1033184993221,8cyclictest1141371-21sendmail00:20:001
1033184993221,7cyclictest0-21swapper/121:50:011
1033184993220,8cyclictest1134560-21sendmail23:59:591
1033180993224,4cyclictest0-21swapper/023:20:270
1033180993224,4cyclictest0-21swapper/021:40:010
1033180993224,4cyclictest0-21swapper/020:25:010
1033180993222,6cyclictest0-21swapper/022:40:010
1033180993222,6cyclictest0-21swapper/022:30:250
1033180993222,6cyclictest0-21swapper/019:52:160
1033193993125,3cyclictest0-21swapper/322:30:013
1033193993123,4cyclictest0-21swapper/323:25:263
1033193993123,4cyclictest0-21swapper/323:15:233
1033193993118,11cyclictest1033171-21cyclictest21:10:123
103318999316,17cyclictest0-21swapper/223:15:002
1033189993124,5cyclictest1110117-21kworker/u8:2+events_unbound23:22:582
1033189993124,4cyclictest0-21swapper/221:30:002
1033189993123,4cyclictest0-21swapper/219:35:012
1033189993122,6cyclictest311ktimers/221:55:112
1033189993122,5cyclictest0-21swapper/220:35:272
1033189993121,5cyclictest0-21swapper/219:45:012
1033189993121,4cyclictest131rcu_preempt21:45:252
1033184993124,5cyclictest1070213-21kworker/u8:1+events_unbound21:02:301
1033184993124,3cyclictest0-21swapper/122:10:171
1033184993123,4cyclictest0-21swapper/123:30:251
1033184993123,4cyclictest0-21swapper/123:30:241
1033184993123,4cyclictest0-21swapper/123:05:251
1033184993123,4cyclictest0-21swapper/122:05:251
1033184993123,4cyclictest0-21swapper/121:20:161
1033184993122,5cyclictest0-21swapper/120:25:011
103318499311,6cyclictest131rcu_preempt19:15:111
1033180993123,4cyclictest0-21swapper/000:10:260
1033180993122,5cyclictest1053120-21apt20:05:000
1033180993121,6cyclictest0-21swapper/020:10:260
1033193993022,5cyclictest0-21swapper/320:50:263
1033189993024,4cyclictest1073783-21kworker/u8:0+events_unbound21:05:182
1033189993024,4cyclictest1073783-21kworker/u8:0+events_unbound21:05:172
1033189993023,4cyclictest1051191-21apt-get20:00:012
1033189993022,6cyclictest311ktimers/200:00:142
1033189993022,5cyclictest1-21systemd20:22:202
103318999301,5cyclictest10908252cat21:50:252
1033184993019,6cyclictest0-21swapper/121:55:251
1033184993017,8cyclictest231ktimers/119:25:101
1033180993023,4cyclictest1131022-21latency_hist23:50:010
1033180993023,3cyclictest0-21swapper/021:45:250
1033180993021,4cyclictest0-21swapper/020:47:250
1033193992920,6cyclictest0-21swapper/323:55:253
1033189992919,6cyclictest0-21swapper/221:35:262
1033184992921,4cyclictest0-21swapper/123:45:261
1033180992924,3cyclictest11-21ksoftirqd/023:05:130
1033180992919,6cyclictest0-21swapper/021:00:240
1033180992918,7cyclictest0-21swapper/022:40:250
1033193992820,4cyclictest0-21swapper/321:55:243
1033193992820,4cyclictest0-21swapper/321:35:283
1033193992820,4cyclictest0-21swapper/320:20:283
1033193992817,7cyclictest0-21swapper/300:25:273
103318999281,6cyclictest0-21swapper/220:05:122
1033189992810,6cyclictest1125479-21kworker/u8:2+events_unbound23:40:132
1033184992818,5cyclictest0-21swapper/122:30:251
1033184992817,7cyclictest0-21swapper/121:55:001
1033180992822,4cyclictest1100018-21cron22:20:000
1033180992822,3cyclictest1043949-21kthreadd19:40:000
1033180992821,5cyclictest1054435-21kworker/u8:0+events_unbound20:07:200
1033180992820,5cyclictest0-21swapper/020:20:010
1033180992820,5cyclictest0-21swapper/019:40:230
1033180992819,4cyclictest0-21swapper/021:05:250
1033180992819,4cyclictest0-21swapper/021:05:250
1033180992818,6cyclictest0-21swapper/000:30:160
1033193992719,4cyclictest0-21swapper/300:05:253
1033193992718,6cyclictest1139236-21unixbench_singl00:10:253
1033193992717,6cyclictest0-21swapper/320:30:273
103318999272,8cyclictest32-21ksoftirqd/222:05:002
103318999272,8cyclictest32-21ksoftirqd/222:04:592
1033189992720,5cyclictest1041921-21kworker/u8:1+events_unbound19:38:102
103318999271,13cyclictest0-21swapper/219:52:232
1033184992720,5cyclictest1118754-21kworker/u8:0+events_unbound23:16:431
1033184992717,6cyclictest0-21swapper/120:35:271
1033184992716,8cyclictest1049270-21cron19:54:591
1033180992718,5cyclictest0-21swapper/023:15:000
1033180992718,5cyclictest0-21swapper/000:25:000
1033193992619,3cyclictest0-21swapper/323:05:013
1033193992618,5cyclictest0-21swapper/322:35:263
1033193992618,4cyclictest0-21swapper/323:35:273
1033193992618,4cyclictest0-21swapper/320:45:013
1033193992618,4cyclictest0-21swapper/319:30:263
1033193992618,4cyclictest0-21swapper/300:30:253
1033193992617,6cyclictest0-21swapper/323:50:013
1033193992616,6cyclictest0-21swapper/321:50:013
1033193992614,8cyclictest0-21swapper/320:05:243
103318999267,4cyclictest1112169-21kworker/u8:1+events_unbound23:05:572
1033189992619,5cyclictest1137739-21kworker/u8:2+events_unbound00:10:142
1033189992619,5cyclictest1112169-21kworker/u8:1+events_unbound22:55:152
1033189992619,5cyclictest1031309-21kworker/u8:0+events_unbound19:15:182
1033184992621,3cyclictest146-21jbd2/mmcblk1p2-823:50:221
1033184992619,3cyclictest0-21swapper/123:40:271
1033184992618,5cyclictest1123644-21unixbench_multi23:25:261
1033184992617,4cyclictest0-21swapper/122:00:161
1033184992617,4cyclictest0-21swapper/122:00:161
103318499260,14cyclictest0-21swapper/120:15:261
1033180992622,2cyclictest13650irq/42-30be0000.ethernet20:35:150
1033180992619,3cyclictest0-21swapper/023:30:230
1033180992619,3cyclictest0-21swapper/023:30:230
1033180992619,3cyclictest0-21swapper/019:30:150
1033180992617,5cyclictest0-21swapper/023:19:590
1033180992616,6cyclictest0-21swapper/023:25:260
1033180992616,6cyclictest0-21swapper/022:00:250
1033180992616,6cyclictest0-21swapper/022:00:250
1033180992616,6cyclictest0-21swapper/021:55:240
1033193992519,3cyclictest0-21swapper/322:40:163
1033193992518,4cyclictest0-21swapper/319:20:263
1033193992517,5cyclictest0-21swapper/300:20:263
1033193992516,6cyclictest0-21swapper/319:45:013
1033193992514,7cyclictest1105128-21sh22:35:013
1033189992518,5cyclictest1101612-21kworker/u8:1+events_unbound22:33:052
1033189992517,6cyclictest1091395-21kworker/u8:2+events_unbound22:14:322
1033189992514,5cyclictest131rcu_preempt20:35:022
1033189992511,9cyclictest1-21systemd22:52:492
103318999251,12cyclictest0-21swapper/223:01:182
103318999250,13cyclictest0-21swapper/222:05:102
1033184992519,4cyclictest1031309-21kworker/u8:0+events_unbound19:31:041
1033184992518,4cyclictest1118207-21find23:10:251
1033184992518,4cyclictest1075496-21kworker/u8:3+events_unbound21:12:231
1033184992518,3cyclictest0-21swapper/120:10:241
1033184992517,5cyclictest0-21swapper/123:35:171
1033184992517,5cyclictest0-21swapper/122:25:151
1033184992517,4cyclictest0-21swapper/120:50:011
1033180992519,4cyclictest0-21swapper/021:25:120
1033180992519,3cyclictest0-21swapper/020:30:010
1033180992516,6cyclictest0-21swapper/019:30:010
1033180992515,7cyclictest1071351-21ntpq20:55:210
103318099251,20cyclictest0-21swapper/019:16:030
1033193992418,3cyclictest1124549-21fschecks_time23:30:163
1033193992418,3cyclictest1124549-21fschecks_time23:30:163
1033193992418,3cyclictest0-21swapper/322:50:243
1033193992418,3cyclictest0-21swapper/321:04:593
1033193992417,4cyclictest0-21swapper/322:05:253
1033193992417,3cyclictest0-21swapper/321:55:003
1033193992416,5cyclictest1148384-21cron00:39:593
1033193992416,5cyclictest0-21swapper/319:35:153
1033189992418,4cyclictest311ktimers/222:45:202
1033189992418,3cyclictest0-21swapper/223:30:202
1033189992418,3cyclictest0-21swapper/223:30:202
1033189992417,5cyclictest1058053-21kworker/u8:1+events_unbound20:16:122
1033184992416,4cyclictest0-21swapper/123:25:001
1033180992413,7cyclictest1127513-21cron23:39:590
1033180992412,10cyclictest11-21ksoftirqd/023:00:140
103318099241,19cyclictest0-21swapper/022:24:020
103318099241,19cyclictest0-21swapper/021:41:150
103318099241,19cyclictest0-21swapper/019:47:200
1033193992318,3cyclictest1053282-21latency_hist20:05:023
1033193992316,3cyclictest0-21swapper/323:20:213
1033193992315,4cyclictest0-21swapper/319:50:003
1033189992316,4cyclictest1066977-21kworker/u8:2+events_unbound20:50:212
1033184992316,4cyclictest1101851-21latency_hist22:25:011
1033184992312,8cyclictest215-21dbus-daemon22:17:431
1033184992312,8cyclictest1037934-21ntp_states19:20:221
103318099231,20cyclictest0-21swapper/019:20:270
103318099231,18cyclictest0-21swapper/023:41:160
103318099231,18cyclictest0-21swapper/020:33:340
103318099230,21cyclictest0-21swapper/021:50:380
1033193992215,5cyclictest1049023-21kworker/u8:2+events_unbound19:57:173
1033193992214,5cyclictest0-21swapper/320:15:273
1033193992213,4cyclictest0-21swapper/321:20:003
103319399221,18cyclictest1131473-21ls23:50:153
1033193992211,6cyclictest0-21swapper/321:25:253
1033184992216,3cyclictest0-21swapper/119:45:251
1033180992215,3cyclictest0-21swapper/022:48:010
103318099221,19cyclictest0-21swapper/020:50:140
1033193992115,3cyclictest0-21swapper/319:15:033
1033193992114,4cyclictest1097051-21fschecks_time22:10:183
1033193992114,4cyclictest1079740-21fschecks_count21:20:163
1033193992111,7cyclictest1119079-21sed23:15:013
1033193992111,6cyclictest0-21swapper/320:25:263
1033184992115,3cyclictest0-21swapper/121:05:201
1033184992115,3cyclictest0-21swapper/121:05:201
1033184992115,3cyclictest0-21swapper/119:10:181
1033184992114,4cyclictest1143686-21fschecks_count00:25:171
1033184992113,5cyclictest231ktimers/122:45:161
1033184992113,4cyclictest0-21swapper/123:00:271
1033184992111,6cyclictest0-21swapper/100:08:301
1033193992011,6cyclictest0-21swapper/322:05:003
1033193992011,6cyclictest0-21swapper/322:04:593
1033184992014,4cyclictest1127203-21kworker/u8:1+events_unbound00:04:301
1033184992013,4cyclictest231ktimers/119:36:361
1033184992013,4cyclictest1060768-21fschecks_count20:25:171
1033193991913,3cyclictest0-21swapper/320:55:173
1033184991912,5cyclictest231ktimers/122:40:121
103318499190,4cyclictest0-21swapper/100:30:131
1033193991812,3cyclictest0-21swapper/321:40:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional